• Files Changed
• Browse Source

• Files Changed
• Browse Source

Forwarded request #1146780 from bnavigator

- Update to 2024.2.0
    * Deprecate Dask DataFrame implementation
    * Improved tokenization
    * https://docs.dask.org/en/stable/changelog.html#v2024-2-0
  - Add distributed-ignore-daskdepr.patch gh#dask/distributed#8504
  - Drop python39 test flavor
  - Fix python312 tests

• Files Changed
• Browse Source

- update to 2024.1.1:
  * see corresponding dask update:
  https://docs.dask.org/en/stable/changelog.html#v2024-1-1
  * compatibility updates for latest pandas and scipy

- update to 2024.1.0:

• Files Changed
• Browse Source

Automatic submission by obs-autosubmit

• Files Changed
• Browse Source

- update to 2023.1.4:
  * see corresponding dask update:
  https://docs.dask.org/en/stable/changelog.html#v2024-1-0

• Files Changed
• Browse Source

Automatic submission by obs-autosubmit

• Files Changed
• Browse Source

Automatic submission by obs-autosubmit

• Files Changed
• Browse Source

- Update to 2023.11.0
- add distributed-ignore-rerun.patch to ignore pytest runners during
  test code introspection
 * Zero-copy P2P Array Rechunking
 * Deprecating PyArrow <14.0.1
 * Improved PyArrow filesystem for Parquet
 * Improve Type Reconciliation in P2P Shuffling
 * official support for Python 3.12
 * Reduced memory pressure for multi array reductions
 * improved P2P shuffling robustness
 * Reduced scheduler CPU load for large graphs (forwarded request 1127182 from mimi_vx)

• Files Changed
• Browse Source

• Files Changed
• Browse Source

- Ratchet up bokeh to >= 3.1, since upstream supports it.
- Also BuildRequire sparse for Python 3.11.

- Update to 2023.5.1
  * This release drops support for Python 3.8
  ## Enhancements
  * Exclude IPython code from computations (GH#7788) Miles
  * Drop Python 3.8 support (GH#7840) Thomas Grainger
  * Add storage_options to performance_report (GH#7636) ypogorelova
  * Don’t warn about mismatched msgpack (GH#7839) Irina Truong
  * Clean up sys.path on Server shutdown (GH#7838) James Bourbeau
  * Dashboard: Fine Performance Metrics (GH#7725) Miles
  ## Bug Fixes
  * Properly handle unknown chunk sizes in P2P rechunking (GH#7856)
    Hendrik Makait
  * Minimal change to work around (GH#7726) / support for UCX
    (GH#7851) Benjamin Zaitlen
  * Don’t end computations until cluster is truly idle (GH#7790)
    crusaderky
- Release 2023.5.0
  ## Enhancements
  * Client.upload_file send to both Workers and Scheduler and
    rename scratch directory (GH#7802) Miles
  * Allow dashboard to be used with bokeh prereleases (GH#7814)
    James Bourbeau
  ## Bug Fixes
  * Ensure log_event of non-msgpack serializable object do not kill
    servers (GH#7472) Florian Jetter
  * Fix test_nanny.py duplicated pytestmark definitions (GH#7819)
    Thomas Grainger

• Files Changed
• Browse Source

• Files Changed
• Browse Source

• Files Changed
• Browse Source

Has to go together with sr#1071019!

- Skip more flaky tests
- Update to 2023.3.1
  ## Enhancements
  * Add Jupyter link to dashboard menu if --jupyter flag is set
    (GH#7638) Jacob Tomlinson
  * Bump minimum click version from 7.0 to 8.0 (GH#7637) Miles
  * Extend dask metapackage dependencies (GH#7630) James Bourbeau
  * Further improvements to Client.restart_workers (GH#7620) Miles
  * P2P offload get_output_partition (GH#7587) Florian Jetter
  * Initial integration of GIL contention metric (GH#7624) Miles
  * Add dashboard documentation links (GH#7610) Miles
  * Rename shuffle/rechunk config option/kwarg to method (GH#7623)
    Hendrik Makait
  * Return results in restart_workers (GH#7606) Miles
  * Ensure client key cancellation uses ordered messages (GH#7583)
    Florian Jetter
  ## Bug Fixes
  * Fix undefined async_wait_for -> async_poll_for (GH#7627) Miles
  * Don’t send client heartbeat without a scheduler_comm (GH#7612)
    James Bourbeau
  * Do not unspill on free-keys (GH#7607) crusaderky
  ## Documentation
  * Add notes to Client.submit, Client.map, and Client.scatter with
    the description of the current task graph resolution algorithm
    limitations (GH#7588) Eugene Druzhynin
  ## Maintenance
  * Use range with pickle protocol versions (GH#7635) jakirkham
  * Share thread pool among P2P shuffle runs (GH#7621) Hendrik
    Makait
  * Replace psutil suspend with BlockedGatherDep in
    test_failing_worker_with_additional_replicas_on_cluster
    (GH#7633) Thomas Grainger
  * Ignore pkg_resources DeprecationWarning for mindeps (GH#7626)
    Miles
  * Implement wait_for using asyncio.timeout() on 3.11 (GH#7571)
    Thomas Grainger
  * Use tmp_path fixture instead of outdated tmpdir fixture
    (GH#7582) ypogorelova
  * Only one crick callback (GH#7614) crusaderky
  * Add mindeps + numpy job to tests CI (GH#7609) Miles
  * Do not xfail whole tests due to (GH#6705) (GH#7611) crusaderky

• Files Changed
• Browse Source

- update to 2023.3.0:
  * Remove pyarrow dependency for rechunking
  * Update rechunk_transfer and rechunk_unpack errors
  * Remove dead code and document arguments to ShardBuffer
    constructors
  * Fix tests for p2p by default
  * Remove obsolete cast

• Files Changed
• Browse Source

HAS TO TOGETHER WITH SR#1068132!

- Prepare test multiflavors for python311, but skip python311
  * Numba is not ready for python 3.11 yet gh#numba/numba#8304
- Update to 2023.2.0
  ## Enhancements
  * Rate limit the worker memory logs (GH#7529) Florian Jetter
  * Move P2P barrier logic to scheduler extension (GH#7519) Hendrik
    Makait

• Files Changed
• Browse Source

• Files Changed
• Browse Source

• Files Changed
• Browse Source

• Files Changed
• Browse Source

• Files Changed
• Browse Source