Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge branch-24.10 into main [skip ci] #11578

Merged
merged 108 commits into from
Oct 14, 2024
Merged

Merge branch-24.10 into main [skip ci] #11578

merged 108 commits into from
Oct 14, 2024

Commits on Jul 24, 2024

  1. Init version 24.10.0-SNAPSHOT

    Keep JNI and private dependency version as 24.08.0-SNAPSHOT until the branch-24.10 nightly CI is done.
    
    Track dependency by: #11240
    
    Signed-off-by: Tim Liu <timl@nvidia.com>
    NvTimLiu committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    1b064c6 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2024

  1. Merge pull request #11252 from NVIDIA/branch-24.08

    [auto-merge] branch-24.08 to branch-24.10 [skip ci] [bot]
    nvauto authored Jul 25, 2024
    Configuration menu
    Copy the full SHA
    eadc6db View commit details
    Browse the repository at this point in the history
  2. Merge pull request #11253 from NVIDIA/branch-24.08

    [auto-merge] branch-24.08 to branch-24.10 [skip ci] [bot]
    nvauto authored Jul 25, 2024
    Configuration menu
    Copy the full SHA
    bce9d51 View commit details
    Browse the repository at this point in the history
  3. Merge pull request #11257 from NVIDIA/branch-24.08

    [auto-merge] branch-24.08 to branch-24.10 [skip ci] [bot]
    nvauto authored Jul 25, 2024
    Configuration menu
    Copy the full SHA
    5d1b82b View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2024

  1. Merge pull request #11261 from NVIDIA/branch-24.08

    [auto-merge] branch-24.08 to branch-24.10 [skip ci] [bot]
    nvauto authored Jul 26, 2024
    Configuration menu
    Copy the full SHA
    469bab4 View commit details
    Browse the repository at this point in the history
  2. Merge pull request #11262 from NVIDIA/branch-24.08

    [auto-merge] branch-24.08 to branch-24.10 [skip ci] [bot]
    nvauto authored Jul 26, 2024
    Configuration menu
    Copy the full SHA
    c5059a7 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2024

  1. Merge pull request #11271 from NVIDIA/branch-24.08

    [auto-merge] branch-24.08 to branch-24.10 [skip ci] [bot]
    nvauto authored Jul 30, 2024
    Configuration menu
    Copy the full SHA
    09b2dd5 View commit details
    Browse the repository at this point in the history
  2. Merge pull request #11272 from NVIDIA/branch-24.08

    [auto-merge] branch-24.08 to branch-24.10 [skip ci] [bot]
    nvauto authored Jul 30, 2024
    Configuration menu
    Copy the full SHA
    97f6d4d View commit details
    Browse the repository at this point in the history
  3. Update the rapids JNI and private dependency version to 24.10.0-SNAPS…

    …HOT (#11267)
    
    Fix issue : #11240
    
    Update the rapids JNI and private dependency version to 24.10.0-SNAPSHOT as the nightly CI has been completed
    
    Signed-off-by: Tim Liu <timl@nvidia.com>
    NvTimLiu authored Jul 30, 2024
    Configuration menu
    Copy the full SHA
    2e0e22b View commit details
    Browse the repository at this point in the history
  4. Merge pull request #11274 from NVIDIA/branch-24.08

    [auto-merge] branch-24.08 to branch-24.10 [skip ci] [bot]
    nvauto authored Jul 30, 2024
    Configuration menu
    Copy the full SHA
    99c2d12 View commit details
    Browse the repository at this point in the history
  5. Merge pull request #11275 from NVIDIA/branch-24.08

    [auto-merge] branch-24.08 to branch-24.10 [skip ci] [bot]
    nvauto authored Jul 30, 2024
    Configuration menu
    Copy the full SHA
    079cf38 View commit details
    Browse the repository at this point in the history
  6. Explicitly disable ANSI mode for ast_test.py [databricks] (#11258)

    * disable ansi for ast_test
    
    * Signing off
    
    Signed-off-by: Raza Jafri <raza.jafri@gmail.com>
    
    ---------
    
    Signed-off-by: Raza Jafri <raza.jafri@gmail.com>
    razajafri authored Jul 30, 2024
    Configuration menu
    Copy the full SHA
    6779154 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. Merge pull request #11279 from NVIDIA/branch-24.08

    [auto-merge] branch-24.08 to branch-24.10 [skip ci] [bot]
    nvauto authored Jul 31, 2024
    Configuration menu
    Copy the full SHA
    e53f234 View commit details
    Browse the repository at this point in the history
  2. Asynchronously copy table data to the host during shuffle (#11280)

    * Copy table columns back to the host asynchronously
    
    Signed-off-by: Jason Lowe <jlowe@nvidia.com>
    
    * Avoid synchronizing until after the device buffers have been freed
    
    * Use withResource
    
    ---------
    
    Signed-off-by: Jason Lowe <jlowe@nvidia.com>
    jlowe authored Jul 31, 2024
    Configuration menu
    Copy the full SHA
    dfcff71 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2024

  1. remove spark31x tools supported files (#11285)

    Signed-off-by: cindyyuanjiang <cindyj@nvidia.com>
    cindyyuanjiang authored Aug 2, 2024
    Configuration menu
    Copy the full SHA
    6c93a1b View commit details
    Browse the repository at this point in the history
  2. Move easy unshimmed classes to sql-plugin-api (#11288)

    Contributes to #11208
    
    Signed-off-by: Gera Shegalov <gera@apache.org>
    gerashegalov authored Aug 2, 2024
    Configuration menu
    Copy the full SHA
    cfac0b9 View commit details
    Browse the repository at this point in the history
  3. Use distinct count to estimate join magnification factor (#11284)

    Signed-off-by: Jason Lowe <jlowe@nvidia.com>
    jlowe authored Aug 2, 2024
    Configuration menu
    Copy the full SHA
    2af9c0e View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2024

  1. Merge pull request #11298 from NVIDIA/branch-24.08

    [auto-merge] branch-24.08 to branch-24.10 [skip ci] [bot]
    nvauto authored Aug 5, 2024
    Configuration menu
    Copy the full SHA
    96d32f0 View commit details
    Browse the repository at this point in the history
  2. Remove redundant classes from the dist jar and unshimmed list (#11295)

    Fixes #11294
    
    - Additionally removes classes from unshimmed-common-from-spark320.txt, 
    which should have been done in #11288.
    -  rapids4spark build properties can be removed from that list because there is a copy of it in sql-plugin-api jar
    - Sort remaining entries
        
    Signed-off-by: Gera Shegalov <gera@apache.org>
    gerashegalov authored Aug 5, 2024
    Configuration menu
    Copy the full SHA
    e7f218a View commit details
    Browse the repository at this point in the history
  3. Use the new chunked API fro multi-get_json_object (#11289)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Aug 5, 2024
    Configuration menu
    Copy the full SHA
    93cdae1 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. Enable get_json_object by default and remove legacy version (#11299)

    * Enable get_json_object by default and remove legacy version
    
    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    
    * Updated docs for 4.0.0 release
    
    ---------
    
    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Aug 6, 2024
    Configuration menu
    Copy the full SHA
    a0cbd1d View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. Skip deploying non-critical intermediate artifacts (#11301)

    Signed-off-by: Yinqing Hao <haoyinqing@gmail.com>
    yinqingh authored Aug 7, 2024
    Configuration menu
    Copy the full SHA
    18980f7 View commit details
    Browse the repository at this point in the history
  2. Fix display issue of lore.md (#11302)

    * Fix display issue of lore.md
    
    Signed-off-by: liurenjie1024 <liurenjie2008@gmail.com>
    
    * Add limitations
    
    * Fix comments
    
    ---------
    
    Signed-off-by: liurenjie1024 <liurenjie2008@gmail.com>
    liurenjie1024 authored Aug 7, 2024
    Configuration menu
    Copy the full SHA
    8ef2e41 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2024

  1. Add jihoonson as an authorized user for blossom-ci (#11312)

    Signed-off-by: Jihoon Son <ghoonson@gmail.com>
    jihoonson authored Aug 8, 2024
    Configuration menu
    Copy the full SHA
    a54c9b3 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2024

  1. Configuration menu
    Copy the full SHA
    8827bd8 View commit details
    Browse the repository at this point in the history
  2. To skip this '*'

    Signed-off-by: Tim Liu <timl@nvidia.com>
    NvTimLiu committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    a4bafa7 View commit details
    Browse the repository at this point in the history
  3. Merge pull request #11313 from NvTimLiu/fix-auto-merge-conflict-11310

    Fix auto merge conflict 10845 11310 [skip ci]
    nvauto authored Aug 9, 2024
    Configuration menu
    Copy the full SHA
    de39a94 View commit details
    Browse the repository at this point in the history
  4. Safely close multiple resources in RapidsBufferCatalog (#11307)

    * Safely close multiple resources in RapidsBufferCatalog
    
    Signed-off-by: Jihoon Son <ghoonson@gmail.com>
    
    * remove duplicate null filtering
    
    * add nullafying back
    
    ---------
    
    Signed-off-by: Jihoon Son <ghoonson@gmail.com>
    jihoonson authored Aug 9, 2024
    Configuration menu
    Copy the full SHA
    05152f7 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2024

  1. Merge pull request #11315 from NVIDIA/branch-24.08

    [auto-merge] branch-24.08 to branch-24.10 [skip ci] [bot]
    nvauto authored Aug 10, 2024
    Configuration menu
    Copy the full SHA
    1101427 View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2024

  1. Update passing JSON tests after list support added in CUDF (#11319)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Aug 13, 2024
    Configuration menu
    Copy the full SHA
    36b9e2c View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. Configuration menu
    Copy the full SHA
    48d8b3d View commit details
    Browse the repository at this point in the history
  2. Merge pull request #11325 from NvTimLiu/fix-auto-merge-conflict-11317

    Fix auto merge conflict 11317 [skip ci]
    jlowe authored Aug 14, 2024
    Configuration menu
    Copy the full SHA
    a85d101 View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2024

  1. Append ustcfy to blossom-ci whitelist [skip ci] (#11324)

    Signed-off-by: ustcfy <yafeng@nvidia.com>
    ustcfy authored Aug 15, 2024
    Configuration menu
    Copy the full SHA
    a876df0 View commit details
    Browse the repository at this point in the history
  2. Make hive column matches not case-sensitive (#11327)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Aug 15, 2024
    Configuration menu
    Copy the full SHA
    25be396 View commit details
    Browse the repository at this point in the history
  3. Fix the mismatching default configs in integration tests (#11283)

    * Add a new interface to retrieve all configs with their defaults; Add a new stage for integration test to populate default configs
    
    Signed-off-by: Jihoon Son <ghoonson@gmail.com>
    
    * address comments
    
    * missing version update in 2.13 pom
    
    * fix match arms
    
    * take the json file path as an input
    
    * add the new config file in the assembly
    
    * missing 2.13 change
    
    * use maven build directory var
    
    * revert unintended change
    
    * remove unnecessary clean
    
    * Add a new interface to retrieve all configs with their defaults; Add a new stage for integration test to populate default configs
    
    Signed-off-by: Jihoon Son <ghoonson@gmail.com>
    
    * address comments
    
    * missing version update in 2.13 pom
    
    * fix match arms
    
    * take the json file path as an input
    
    * add the new config file in the assembly
    
    * missing 2.13 change
    
    * use maven build directory var
    
    * revert unintended change
    
    * remove unnecessary clean
    
    * Add things in RapidsConf
    
    * missing change for 2.13
    
    * fix directory path for scala 2.13
    
    * exclude jackson from spark-hive
    
    * missing change for 2.13
    
    * exclude old jackson stuff from iceberg
    
    * copyrights
    
    * antrun
    
    * fix config file path
    
    * move most dump changes to rapids conf
    
    - fork generation step with maven.compile.classpath
    - change to a phase before package
    
    Signed-off-by: Gera Shegalov <gera@apache.org>
    
    * clean up after merge
    
    * scala 2.13
    
    * more strict arg check
    
    * unpack ambiguous string arguments
    
    * allow legacy negative scale for decimals for some tests
    
    * should fork for RapidsConf
    
    * remove System.exit() from RapidsConf.main()
    
    * missing change for scala 2.13
    
    * Fix more tests to set configs
    
    * add back explicit configs
    
    ---------
    
    Signed-off-by: Jihoon Son <ghoonson@gmail.com>
    Signed-off-by: Gera Shegalov <gera@apache.org>
    Co-authored-by: Gera Shegalov <gera@apache.org>
    jihoonson and gerashegalov authored Aug 15, 2024
    Configuration menu
    Copy the full SHA
    bc8c577 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. Merge pull request #11336 from NVIDIA/branch-24.08

    [auto-merge] branch-24.08 to branch-24.10 [skip ci] [bot]
    nvauto authored Aug 16, 2024
    Configuration menu
    Copy the full SHA
    6283029 View commit details
    Browse the repository at this point in the history
  2. Merge pull request #11338 from NVIDIA/branch-24.08

    [auto-merge] branch-24.08 to branch-24.10 [skip ci] [bot]
    nvauto authored Aug 16, 2024
    Configuration menu
    Copy the full SHA
    2d90ec8 View commit details
    Browse the repository at this point in the history
  3. Audit script - Check commits from sql-hive directory [skip ci] (#11340)

    * Audit script - Check commits from sql-hive directory
    
    Signed-off-by: Niranjan Artal <nartal@nvidia.com>
    
    * update audit path
    
    Signed-off-by: Niranjan Artal <nartal@nvidia.com>
    
    ---------
    
    Signed-off-by: Niranjan Artal <nartal@nvidia.com>
    nartal1 authored Aug 16, 2024
    Configuration menu
    Copy the full SHA
    c0c93b3 View commit details
    Browse the repository at this point in the history
  4. replace inputFiles with location.rootPaths.toString (#11323)

    Signed-off-by: Zach Puller <zpuller@nvidia.com>
    zpuller authored Aug 16, 2024
    Configuration menu
    Copy the full SHA
    5302651 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2024

  1. Revert "Fix the mismatching default configs in integration tests (#11283

    )" (#11347)
    
    This reverts commit bc8c577.
    
    Signed-off-by: Jihoon Son <ghoonson@gmail.com>
    jihoonson authored Aug 17, 2024
    Configuration menu
    Copy the full SHA
    a61b834 View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2024

  1. Configuration menu
    Copy the full SHA
    c412433 View commit details
    Browse the repository at this point in the history
  2. Merge pull request #11357 from pxLi/fix-auto-merge-conflict-11354

    Fix auto merge conflict 11354 [skip ci]
    pxLi authored Aug 18, 2024
    Configuration menu
    Copy the full SHA
    2133b7d View commit details
    Browse the repository at this point in the history
  3. Fix 24.08 download doc (#11358)

    Signed-off-by: Peixin Li <pxLi@nyu.edu>
    pxLi authored Aug 18, 2024
    Configuration menu
    Copy the full SHA
    6fb3205 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2024

  1. Swap build side for outer joins when natural build side is explosive …

    …[databricks] (#11328)
    
    * Swap build side for outer joins when natural build side is explosive
    
    Signed-off-by: Jason Lowe <jlowe@nvidia.com>
    
    * scalastyle fix
    
    * Add clarification and sanity checking for sub join type
    
    * Use GpuExpression for bound join keys to improve type safety
    
    * test fix
    
    ---------
    
    Signed-off-by: Jason Lowe <jlowe@nvidia.com>
    jlowe authored Aug 19, 2024
    Configuration menu
    Copy the full SHA
    15aa45c View commit details
    Browse the repository at this point in the history
  2. Add string escaping JSON tests to the test_json_matrix (#10604)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Aug 19, 2024
    Configuration menu
    Copy the full SHA
    92d9bbb View commit details
    Browse the repository at this point in the history
  3. conform dependency list in 341db to previous versions style [databric…

    …ks] (#11321)
    
    * conform dependency list in 341db to previous versions style
    
    Signed-off-by: Zach Puller <zpuller@nvidia.com>
    
    * make shim deps artifact parent of all delta lake spark shim builds
    
    Signed-off-by: Zach Puller <zpuller@nvidia.com>
    
    * remove rapids-4-spark-db-bom explicit dependency from delta databricks shims
    
    Signed-off-by: Zach Puller <zpuller@nvidia.com>
    
    ---------
    
    Signed-off-by: Zach Puller <zpuller@nvidia.com>
    zpuller authored Aug 19, 2024
    Configuration menu
    Copy the full SHA
    b23e3fa View commit details
    Browse the repository at this point in the history
  4. Add tests for repeated columns (#11362)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Aug 19, 2024
    Configuration menu
    Copy the full SHA
    2495b72 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. Fix failing test compile for Spark 4.0.0 (#11363)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Aug 20, 2024
    Configuration menu
    Copy the full SHA
    6924404 View commit details
    Browse the repository at this point in the history
  2. Set numRows for the ColumnBatch created in GpuBringBackToHost (#11365)

    * Set numRows for the ColumnBatch created in GpuBringBackToHost
    
    Signed-off-by: Jihoon Son <ghoonson@gmail.com>
    
    * Directly get row count from the input ColumnarBatch
    
    * update copyright
    
    * fix copyright for the right file
    
    ---------
    
    Signed-off-by: Jihoon Son <ghoonson@gmail.com>
    jihoonson authored Aug 20, 2024
    Configuration menu
    Copy the full SHA
    9fcd8c7 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. Change reference to MapUtils into JSONUtils (#11329)

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    ttnghia authored Aug 21, 2024
    Configuration menu
    Copy the full SHA
    3023625 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. Move SparkRapidsBuildInfoEvent to its own file (#11368)

    Signed-off-by: Thomas Graves <tgraves@nvidia.com>
    tgravescs authored Aug 22, 2024
    Configuration menu
    Copy the full SHA
    eb7b927 View commit details
    Browse the repository at this point in the history
  2. Fix nightly snapshots being downloaded in premerge build (#11383)

    Signed-off-by: Jason Lowe <jlowe@nvidia.com>
    jlowe authored Aug 22, 2024
    Configuration menu
    Copy the full SHA
    0f5254b View commit details
    Browse the repository at this point in the history
  3. Create a PrioritySemaphore to back the GpuSemaphore (#11376)

    * priority semaphore implementation and tests
    
    Signed-off-by: Zach Puller <zpuller@nvidia.com>
    
    ---------
    
    Signed-off-by: Zach Puller <zpuller@nvidia.com>
    zpuller authored Aug 22, 2024
    Configuration menu
    Copy the full SHA
    35d2163 View commit details
    Browse the repository at this point in the history
  4. Fix spark400 build in datagen and tests (#11375)

    Signed-off-by: Jason Lowe <jlowe@nvidia.com>
    jlowe authored Aug 22, 2024
    Configuration menu
    Copy the full SHA
    d53de06 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2024

  1. JSON tests for corrected date, timestamp, and mixed types (#11388)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Aug 23, 2024
    Configuration menu
    Copy the full SHA
    6148257 View commit details
    Browse the repository at this point in the history
  2. Add support for Spark 3.5.2 [databricks] (#11334)

    * Added 352 support
    
    * 352 building
    
    * Remove 352 from SNAPSHOT
    
    * Generated 2.13 pom
    
    * Removed 352 from snapshot in pom.xml
    
    * Signing off
    
    Signed-off-by: Raza Jafri <raza.jafri@gmail.com>
    
    * Added 352 to 213 snapshots and copyrights updated
    
    * Updated copyrights
    
    * Updated copyrights
    
    * Updated copyrights for SparkShimsSuite
    
    * addressed review comments
    
    * Fixed bad merge
    
    ---------
    
    Signed-off-by: Raza Jafri <raza.jafri@gmail.com>
    razajafri authored Aug 23, 2024
    Configuration menu
    Copy the full SHA
    ac49393 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2024

  1. Revert work-around for empty split-string (#11393)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Aug 26, 2024
    Configuration menu
    Copy the full SHA
    35c593c View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. Drop cudf-py python 3.9 support (#11396)

    Change the default cudf-py version to python3.10, because rapidsai has dropped python3.9 support
    
    Signed-off-by: Tim Liu <timl@nvidia.com>
    NvTimLiu authored Aug 27, 2024
    Configuration menu
    Copy the full SHA
    eb5735c View commit details
    Browse the repository at this point in the history
  2. Add distinct join support for right outer joins (#11291)

    * Add distinct join support for RightOuter joins
    
    Signed-off-by: Jason Lowe <jlowe@nvidia.com>
    
    * Fix build
    
    ---------
    
    Signed-off-by: Jason Lowe <jlowe@nvidia.com>
    jlowe authored Aug 27, 2024
    Configuration menu
    Copy the full SHA
    3e04c1f View commit details
    Browse the repository at this point in the history
  3. prevent duplicate queueing in the prio semaphore (#11389)

    * prevent duplicate queueing in the prio semaphore
    
    Signed-off-by: Zach Puller <zpuller@nvidia.com>
    
    ---------
    
    Signed-off-by: Zach Puller <zpuller@nvidia.com>
    zpuller authored Aug 27, 2024
    Configuration menu
    Copy the full SHA
    549daf6 View commit details
    Browse the repository at this point in the history
  4. stop using copyWithBooleanColumnAsValidity (#11399)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Aug 27, 2024
    Configuration menu
    Copy the full SHA
    46057a4 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. Merge pull request #11406 from NVIDIA/branch-24.08

    [auto-merge] branch-24.08 to branch-24.10 [skip ci] [bot]
    nvauto authored Aug 28, 2024
    Configuration menu
    Copy the full SHA
    61f0cca View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. Support MinBy and MaxBy for non-float ordering (#11371)

    * Support minBy on GPU
    
    Signed-off-by: Firestarman <firestarmanllc@gmail.com>
    
    * Support minBy on GPU
    
    Signed-off-by: Firestarman <firestarmanllc@gmail.com>
    
    * max_by wip
    
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    
    * wip
    
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    
    * test wip
    
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    
    * wip test
    
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    
    * reverse order and value
    
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    
    * use min instead of min_by
    
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    
    * verify again
    
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    
    * regenerate shim docs
    
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    
    * refine reduction and limit float type
    
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    
    * 400 doc
    
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    
    * update tests
    
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    
    * verify and address comments
    
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    
    * fix IT on spark320 and combine tests
    
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    
    * remove 311 docs
    
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    
    * comment address
    
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    
    ---------
    
    Signed-off-by: Firestarman <firestarmanllc@gmail.com>
    Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
    Co-authored-by: Firestarman <firestarmanllc@gmail.com>
    thirtiseven and firestarman authored Aug 29, 2024
    Configuration menu
    Copy the full SHA
    dbd92d2 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. Fix a Pandas UDF slowness issue (#11395)

    Close #10770
    
    In CombiningIterator, the call to hasNext of pythonOutputIter may trigger a read without setting the target rows
    number, and the default rows number is Int.MaxValue, then the GpuArrowReader will try to read in a quite big
    batch when the partition data is big enough, leading to too much data copying by
    DirectByteBufferOutputStream at the writer side. Then slowness comes up.
    
    This PR changes the default read rows number to arrowMaxRecordsPerBatch to align with the Arrow
     batching behavior in Spark, and set the target read rows number in the hasNext function too.
    
    ---------
    
    Signed-off-by: Firestarman <firestarmanllc@gmail.com>
    firestarman authored Aug 30, 2024
    Configuration menu
    Copy the full SHA
    db1d580 View commit details
    Browse the repository at this point in the history
  2. Fix asymmetric join crash when stream side is empty (#11411)

    Signed-off-by: Jason Lowe <jlowe@nvidia.com>
    jlowe authored Aug 30, 2024
    Configuration menu
    Copy the full SHA
    ee2049a View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. Stop using copyWithBooleanColumnAsValidity [databricks] (#11418)

    * stop using copyWithBooleanColumnAsValidity
    
    Signed-off-by: Chong Gao <res_life@163.com>
    
    * Refactor: rename variable
    
    ---------
    
    Signed-off-by: Chong Gao <res_life@163.com>
    Co-authored-by: Chong Gao <res_life@163.com>
    res-life and Chong Gao authored Sep 3, 2024
    Configuration menu
    Copy the full SHA
    6d4c4ef View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. Add in array_join support (#11420)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Sep 4, 2024
    Configuration menu
    Copy the full SHA
    d2abcd9 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. Update signoff usage (#11425)

    Signed-off-by: Peixin Li <pxLi@nyu.edu>
    pxLi authored Sep 5, 2024
    Configuration menu
    Copy the full SHA
    53bf03a View commit details
    Browse the repository at this point in the history
  2. Update CI scripts (#11427)

    Move '. version-def.sh' ahead of 'cd scala2.13' in the spark-nightly-build.sh, to work with the "Dynamic Shim Detection" PR11308,
    
    Get the base shim version in deploy.sh using fuzzy matching instead of relying on version-def.sh
    
    Signed-off-by: timl <timl@nvidia.com>
    NvTimLiu authored Sep 5, 2024
    Configuration menu
    Copy the full SHA
    5d7dc39 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. Dynamic Shim Detection for build Process [databricks] (#11308)

    * Removed irrelevant profiles for Scala 2.13
    
    * Added an ant target to replace profiles
    
    * Modified buildall script to use the new way
    
    * Added function to consume the antrun plugin for version-def
    
    * Added all.buildvers
    
    * Added changes to version-def and shimplify
    
    * Clean up
    
    * Refactored python script to an external file
    
    * Changed the location of release.properties, added it to a property and added logging
    
    * Use exec tag to execute bash
    
    Signed-off-by: Raza Jafri <raza.jafri@gmail.com>
    
    * clean up
    
    * few more changes
    
    * Added a way to remove shims from releases
    
    * included_buildvers changes
    
    * undo version-def echos
    
    * removed unnecessary comment
    
    * removed method for mapping json
    
    * Added an xpath alternative to speed up the build
    
    * Added message to inform user about the missing package for speeding up the creation of the release.properties
    
    * Removed bash script and used jython to get releases
    
    * undo .gitignore change
    
    * removed the unused param overwrite_properties
    
    * cleanup
    
    * removed the call to create properties file
    
    * addressed review comments
    
    * removed unnecessary property
    
    * regenerated scala2.13
    
    * Removed antrun execution from pom and refactored the python script so we can call it independently from CLI.
    
    * Addressed adding comments to Python script
    
    * added quotes to project so it's not mistaken for the word project but the variable project
    
    * moved the comment down a line
    
    * Call python script to get buildvers
    
    * Addressed review comments
    
    * Removed some of the references of snapshots and noSnapshots
    
    * addressed review comments and other minor changes
    
    * replaced expression with buildvers
    
    * Added dist profiles
    
    * Changed the phase so it runs after initialize
    
    * Added databricks profile
    
    * Regenerated 2.13 pom
    
    * Addressed review comments
    
    * missed comma in databricks
    
    ---------
    
    Signed-off-by: Raza Jafri <raza.jafri@gmail.com>
    razajafri authored Sep 6, 2024
    Configuration menu
    Copy the full SHA
    4c2203e View commit details
    Browse the repository at this point in the history
  2. remove the redundant archive link (#11421)

    Signed-off-by: liyuan <yuali@nvidia.com>
    nvliyuan authored Sep 6, 2024
    Configuration menu
    Copy the full SHA
    77615e6 View commit details
    Browse the repository at this point in the history
  3. Add companion metrics for all nsTiming metrics without semaphore (#11331

    )
    
    * Add companion metrics for all nsTiming metrics
    
    Signed-off-by: Hongbin Ma (Mahone) <mahongbin@apache.org>
    
    * refine companion metrics
    
    Signed-off-by: Hongbin Ma (Mahone) <mahongbin@apache.org>
    
    ---------
    
    Signed-off-by: Hongbin Ma (Mahone) <mahongbin@apache.org>
    binmahone authored Sep 6, 2024
    Configuration menu
    Copy the full SHA
    7de3fc4 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. xfail array and map cast to string tests (#11451)

    * xfail array and map cast to string tests
    
    Signed-off-by: Jason Lowe <jlowe@nvidia.com>
    
    * Ignore extract mortgage data test
    
    * copyrights
    
    ---------
    
    Signed-off-by: Jason Lowe <jlowe@nvidia.com>
    jlowe authored Sep 9, 2024
    Configuration menu
    Copy the full SHA
    9fc0667 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Log DBR BuildInfo [databricks] (#11455)

    Fixes #8587
     
    - Match the dbrVersion from the binaries
    - Log the build info exposed in current_version
    - Fix the WITH_BLOOP build
    
    ```
    2024-09-10 16:21:42,019 [Thread-6] WARN  com.nvidia.spark.rapids.DatabricksShimServiceProvider - Databricks Runtime Build Info match: SUCCESS
            DBR_VERSION: 11.3.x-snapshot-gpu-ml-scala2.12
            spark.BuildInfo.gitHash: d65fb2374451fd10bf416297dc22549bcbaf2702
            databricks.BuildInfo.gitHash: b7fd9d058866e0f98f78304bf90c690198e2b208
            databricks.BuildInfo.gitTimestamp: 20240820204043
    ```
        
    Signed-off-by: Gera Shegalov <gera@apache.org>
    gerashegalov authored Sep 10, 2024
    Configuration menu
    Copy the full SHA
    a92bfbf View commit details
    Browse the repository at this point in the history
  2. Fixed some of the failing parquet_tests [databricks] (#11429)

    * Fixed some of the failing parquet_tests
    
    * Signing off
    
    Signed-off-by: Raza Jafri <raza.jafri@gmail.com>
    
    * addressed review comments
    
    * removed unused import
    
    ---------
    
    Signed-off-by: Raza Jafri <raza.jafri@gmail.com>
    razajafri authored Sep 10, 2024
    Configuration menu
    Copy the full SHA
    502f5a3 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. Skip test_hash_groupby_approx_percentile byte and double tests tempor…

    …arily (#11469)
    
    Signed-off-by: Alessandro Bellina <abellina@nvidia.com>
    abellina authored Sep 12, 2024
    Configuration menu
    Copy the full SHA
    5beeba8 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2024

  1. Replace scala.util.Try with a try statement in the DBR buildinfo [dat…

    …abricks] (#11466)
    
    * Switch to a regular try
    
    Signed-off-by: Gera Shegalov <gera@apache.org>
    
    * drop Maven tarball
    
    Signed-off-by: Gera Shegalov <gera@apache.org>
    
    * unused import
    
    Signed-off-by: Gera Shegalov <gera@apache.org>
    
    * repro
    
    Signed-off-by: Gera Shegalov <gera@apache.org>
    
    ---------
    
    Signed-off-by: Gera Shegalov <gera@apache.org>
    gerashegalov authored Sep 14, 2024
    Configuration menu
    Copy the full SHA
    938d4df View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Revert "Skip test_hash_groupby_approx_percentile byte and double test…

    …s temporarily (#11469)" (#11473)
    
    This reverts commit 5beeba8.
    
    Signed-off-by: Alessandro Bellina <abellina@nvidia.com>
    abellina authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    65f0095 View commit details
    Browse the repository at this point in the history
  2. Enable tests after string_split was fixed (#11474)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    00cd422 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Use improved CUDF JSON validation (#11464)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    2589976 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. Fix a json test for non utc time zone (#11482)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Sep 18, 2024
    Configuration menu
    Copy the full SHA
    f4119c1 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Use reusable auto-merge workflow (#11483)

    Signed-off-by: Peixin Li <pxLi@nyu.edu>
    pxLi authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    7c13383 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. Enable tests for all JSON white space normalization (#11456)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    4b26190 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. Support yyyyMMdd in GetTimestamp operator for LEGACY mode [databricks] (

    #11449)
    
    * Support yyyyMMdd in GetTimestamp operator for LEGACY mode
    
    Signed-off-by: Chong Gao <res_life@163.com>
    Co-authored-by: Chong Gao <res_life@163.com>
    res-life and Chong Gao authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    0f5d510 View commit details
    Browse the repository at this point in the history
  2. Support non-UTC timezone for casting from date type to timestamp type…

    … [databricks] (#11462)
    
    * Support non-UTC timezone for casting from date type to timestamp type
    Signed-off-by: Chong Gao <res_life@163.com>
    Co-authored-by: Chong Gao <res_life@163.com>
    res-life authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    ebcc146 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Install cuDF-py against python 3.10 on Databricks (#11477)

    * Install cuDF-py against python 3.10 on Databricks
    
    Fix on Databricks runtime for : #11394
    
    Enable the udf_cudf_test test case for Databricks-13.3
    
    Rapids 24.10+ drops python 3.9 or below conda packages. ref: https://docs.rapids.ai/notices/rsn0040/
    
    Install cuDF-py packages against python 3.10 and above on Databricks runtime to run UDF cuDF tests, because on DB-13.3 Conda is not installed by default.
    
    Signed-off-by: timl <timl@nvidia.com>
    
    * Check if 'conda' exists to make the if/else expression more readable
    
    Signed-off-by: timl <timl@nvidia.com>
    
    ---------
    
    Signed-off-by: timl <timl@nvidia.com>
    NvTimLiu authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    510ee83 View commit details
    Browse the repository at this point in the history
  2. Enable parquet suites from Spark UT (#11366)

    * add parquet column index  ut test
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    
    * change
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    
    * added parquet suite
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * pom changed
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * DeltaEncoding Suite
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * enable more suites
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * remove ignored case
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * format
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * added ignored cases
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * change to parquet hadoop version
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    
    * remove parquet.version
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    
    * adding scope and classifier
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    
    * pom remove unused
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * pom chang3 2.13
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * add schema suite
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    
    * remove dataframe
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    
    * RapidsParquetThriftCompatibilitySuite
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * ThriftCompaSuite added
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * more suites but the RowIndexSuite one
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * formatting issues
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * exlude SPARK-36803:
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    
    * setting change
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    
    * setting change
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    
    * adjust order
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    
    * adjust settings
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    
    * adjust settings
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    
    * RapidsParquetThriftCompatibilitySuite settings
    
    * known issue added
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * format new line
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * known issue added
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * RapidsParquetDeltaByteArrayEncodingSuite
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    
    * RapidsParquetAvroCompatibilitySuite
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    
    * ParquetFiledIdSchemaSuite and Avro suite added
    
    * pom Avro suite modified
    
    * ParquetFileFormatSuite added
    
    * RapidsParquetRebaseDatetimeSuite and QuerySuite added
    
    * RapidsParquetSchemaPruningSuite added
    
    * setting adjust
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * setting adjust
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * UT adjuct exclude added
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * RapidsParquetThriftCompatibilitySuite adjust setting
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * comment Create parquet table with compression
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * SPARK_HOME NOT FOUND issue solved.
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * enabling more suite
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * remove exclude from RapidsParquetFieldIdIOSuite
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * formate and remove parquet files
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * comment setting
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    * pom modified and remove unnecess case
    
    Signed-off-by: fejiang <fejiang@nvidia.com>
    
    ---------
    
    Signed-off-by: fejiang <fejiang@nvidia.comm>
    Signed-off-by: fejiang <fejiang@nvidia.com>
    Co-authored-by: fejiang <fejiang@nvidia.comm>
    Feng-Jiang28 and fejiang authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    a34f33e View commit details
    Browse the repository at this point in the history
  3. Optimzing Expand+Aggregate in sqls with many count distinct (#10798)

    * optimzing Expand+Aggregate in sqlw with many count distinct
    
    Signed-off-by: Hongbin Ma (Mahone) <mahongbin@apache.org>
    
    * simplify
    
    Signed-off-by: Hongbin Ma (Mahone) <mahongbin@apache.org>
    
    * add comment
    
    Signed-off-by: Hongbin Ma (Mahone) <mahongbin@apache.org>
    
    * address comments
    
    Signed-off-by: Hongbin Ma (Mahone) <mahongbin@apache.org>
    
    ---------
    
    Signed-off-by: Hongbin Ma (Mahone) <mahongbin@apache.org>
    binmahone authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    5725e2e View commit details
    Browse the repository at this point in the history
  4. Use UnaryLike instead of UnaryExpression (#11490)

    Signed-off-by: Alessandro Bellina <abellina@nvidia.com>
    abellina authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    6a9731f View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Download artifacts via wget (#11503)

    To fix: #11502
    
    Download jars using wget instead of 'mvn dependency:get' to fix 'missing intermediate jars' failures,
    as we stopped deploying these intermediate jars since version 24.10
    
    Signed-off-by: timl <timl@nvidia.com>
    NvTimLiu authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    10eaa22 View commit details
    Browse the repository at this point in the history
  2. Replace libmamba-solver with mamba command [skip ci] (#11507)

    * quick workaround to make image build work
    
    Signed-off-by: Peixin Li <pxLi@nyu.edu>
    
    * use mamba directly
    
    ---------
    
    Signed-off-by: Peixin Li <pxLi@nyu.edu>
    pxLi authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    b113c46 View commit details
    Browse the repository at this point in the history
  3. GPU device watermark metrics (#11457)

    * add max memory watermark metric
    
    Signed-off-by: Zach Puller <zpuller@nvidia.com>
    
    ---------
    
    Signed-off-by: Zach Puller <zpuller@nvidia.com>
    zpuller authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    c047707 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. Fix FileAlreadyExistsException in LORE dump process (#11484)

    * Updated parameters to enable file overwriting when dumping.
    
    Signed-off-by: ustcfy <yafeng@nvidia.com>
    
    * Validate LORE dump root path before execution
    
    Signed-off-by: ustcfy <yafeng@nvidia.com>
    
    * Add loreOutputRootPathChecked map for tracking lore output root path checks.
    
    Signed-off-by: ustcfy <yafeng@nvidia.com>
    
    * Delay path and filesystem initialization until actually needed.
    
    Signed-off-by: ustcfy <yafeng@nvidia.com>
    
    * Add test and update dev/lore.md doc.
    
    Signed-off-by: ustcfy <yafeng@nvidia.com>
    
    * Format code to ensure line length does not exceed 100 characters
    
    Signed-off-by: ustcfy <fengyan_@mail.ustc.edu.cn>
    
    * Format code to ensure line length does not exceed 100 characters
    
    Signed-off-by: ustcfy <fengyan_@mail.ustc.edu.cn>
    
    * Improved resource management by using withResource.
    
    Signed-off-by: ustcfy <fengyan_@mail.ustc.edu.cn>
    
    * Update docs/dev/lore.md
    
    Co-authored-by: Renjie Liu <liurenjie2008@gmail.com>
    
    * Improved resource management by using withResource.
    
    Signed-off-by: ustcfy <fengyan_@mail.ustc.edu.cn>
    
    * Removed  for FileSystem instance.
    
    Signed-off-by: ustcfy <fengyan_@mail.ustc.edu.cn>
    
    * Update docs/dev/lore.md
    
    Co-authored-by: Gera Shegalov <gshegalov@nvidia.com>
    
    ---------
    
    Signed-off-by: ustcfy <yafeng@nvidia.com>
    Signed-off-by: ustcfy <fengyan_@mail.ustc.edu.cn>
    Co-authored-by: Renjie Liu <liurenjie2008@gmail.com>
    Co-authored-by: Gera Shegalov <gshegalov@nvidia.com>
    3 people authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    41351c0 View commit details
    Browse the repository at this point in the history
  2. Deploy all submodules for default sparkver (#11516)

    Signed-off-by: Peixin Li <pxLi@nyu.edu>
    pxLi authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    9625e58 View commit details
    Browse the repository at this point in the history
  3. Update from_json to use new cudf features (#11497)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    fbd4db9 View commit details
    Browse the repository at this point in the history
  4. Fixed buildall script (#11515)

    Signed-off-by: Raza Jafri <raza.jafri@gmail.com>
    razajafri authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    f87ccb9 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. Only test years after 1900 for LEGACY mode (#11545)

    Signed-off-by: Chong Gao <res_life@163.com>
    Co-authored-by: Chong Gao <res_life@163.com>
    res-life and Chong Gao authored Sep 30, 2024
    Configuration menu
    Copy the full SHA
    c74e2dd View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. Fix negative rs. shuffle write time (#11548)

    * Fix negative rs. shuffle write time
    
    Signed-off-by: Alessandro Bellina <abellina@nvidia.com>
    
    * Stop double counting openTimeNs in shuffleWriteTimeMetric
    
    ---------
    
    Signed-off-by: Alessandro Bellina <abellina@nvidia.com>
    abellina authored Oct 1, 2024
    Configuration menu
    Copy the full SHA
    5fae883 View commit details
    Browse the repository at this point in the history
  2. Update test now that code is fixed (#11496)

    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Oct 1, 2024
    Configuration menu
    Copy the full SHA
    8207f7b View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. Fix test case unix_timestamp(col, 'yyyyMMdd') failed for Africa/Casab…

    …lanca timezone and LEGACY mode (#11567)
    
    Signed-off-by: Chong Gao <res_life@163.com>
    res-life authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    b9b7629 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. Have "dump always" dump input files before trying to decode them (#11569

    )
    
    Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
    revans2 authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    b715ef2 View commit details
    Browse the repository at this point in the history
  2. Merge branch-24.10 into main

    nvauto committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    670d8ec View commit details
    Browse the repository at this point in the history
  3. Change version to 24.10.0

    Signed-off-by: nvauto <70000568+nvauto@users.noreply.github.com>
    nvauto committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    85db666 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. backport fixes of #11573 to branch 24.10 (#11588)

    * avoid long tail tasks due to PrioritySemaphore (#11574)
    
    * use task id as tie breaker
    
    Signed-off-by: Hongbin Ma (Mahone) <mahongbin@apache.org>
    
    * save threadlocal lookup
    
    Signed-off-by: Hongbin Ma (Mahone) <mahongbin@apache.org>
    
    ---------
    
    Signed-off-by: Hongbin Ma (Mahone) <mahongbin@apache.org>
    
    * addressing jason's comment
    
    Signed-off-by: Hongbin Ma (Mahone) <mahongbin@apache.org>
    
    ---------
    
    Signed-off-by: Hongbin Ma (Mahone) <mahongbin@apache.org>
    binmahone authored Oct 11, 2024
    Configuration menu
    Copy the full SHA
    ec9d008 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. update doc for 2410 release (#11582)

    Signed-off-by: liyuan <yuali@nvidia.com>
    nvliyuan authored Oct 14, 2024
    Configuration menu
    Copy the full SHA
    8254f63 View commit details
    Browse the repository at this point in the history
  2. Update rapids JNI and private dependency to 24.10.0 (#11576)

    \nWait for the pre-merge CI job to SUCCEED
    
    Signed-off-by: nvauto <70000568+nvauto@users.noreply.github.com>
    nvauto authored Oct 14, 2024
    Configuration menu
    Copy the full SHA
    3c9bb8b View commit details
    Browse the repository at this point in the history
  3. Update latest changelog [skip ci] (#11577)

    * Update latest changelog [skip ci]
    
    Update change log with CLI: \n\n   scripts/generate-changelog --token=<GIT_TOKEN> --releases=24.08,24.10
    
    Signed-off-by: nvauto <70000568+nvauto@users.noreply.github.com>
    
    * Update changelog
    
    Signed-off-by: timl <timl@nvidia.com>
    
    * Update changelog
    
    Signed-off-by: timl <timl@nvidia.com>
    
    ---------
    
    Signed-off-by: nvauto <70000568+nvauto@users.noreply.github.com>
    Signed-off-by: timl <timl@nvidia.com>
    Co-authored-by: timl <timl@nvidia.com>
    nvauto and NvTimLiu authored Oct 14, 2024
    Configuration menu
    Copy the full SHA
    b535f2d View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    4007f2c View commit details
    Browse the repository at this point in the history