Code

Switch to DuckDB#146

Code

Open

bmschmidt wants to merge 44 commits intomasterBookworm-project/BookwormDB:masterfrom quackquackBookworm-project/BookwormDB:quackquackCopy head branch name to clipboard

+2,043-5,830

Commits

Commits on Oct 14, 2020

• Allowing binding to 0.0.0.0 instead of 127.0.0.1

  bmschmidt

  committed
  4e661de

• change user to allow docker

  bmschmidt

  committed
  5134324

• config file tweak

  bmschmidt

  committed
  27551d3

• switch to re from regex

  bmschmidt

  committed
  70cfbc7

• handle remote hosts in API better

  bmschmidt

  committed
  1bc1347

• handling of remove mysql servers

  bmschmidt

  committed
  2769c2c

Commits on Oct 19, 2020

• Allow password files

  bmschmidt

  committed
  6165481

Commits on Feb 3, 2021

• Better field name validation

  bmschmidt

  committed
  89ab79a

• Aesthetic changes, document pre-tokenized data

  bmschmidt

  committed
  372a392

• More informative error message

  bmschmidt

  committed
  e69e9ba

• Restore folder ingest of multiple txt files; Housekeeping

  bmschmidt

  committed
  f81108e

• Merge branches

  bmschmidt

  committed
  ef739d1

• Make remove file tree

  bmschmidt

  committed
  75d18b6

• Fix input.txt parsing

  bmschmidt

  committed
  d1adf0d

• Raise error on invalid catalog entries

  bmschmidt

  committed
  e2117b2

Commits on Feb 5, 2021

• changes to tokenization pipeline internals

  bmschmidt

  committed
  b00e6a9

Commits on Feb 8, 2021

• Add default parsing of ISO date fields where not specified at yearly and daily resolutions

  bmschmidt

  committed
  f0bd78e

Commits on Mar 7, 2021

• better testing

  

  Benjamin Schmidt

  committed
  c086b5c

• Add caching and API extensions to support it.

  

  Benjamin Schmidt

  committed
  0256a20

• register json type for json_c

  bmschmidt

  committed
  f9d6b17

• More error handling on read stage

  bmschmidt

  committed
  088eeae

• More explicit in proofing user queries.

  bmschmidt

  committed
  1d52bfc

• throw more errors

  bmschmidt

  committed
  79282dc

• Reconcile merges

  bmschmidt

  committed
  a6153ec

• Fix cache trimming

  bmschmidt

  committed
  4924755

• 'push' is js, not python. Ugh.

  bmschmidt

  committed
  0ea5871

Commits on Apr 25, 2021

• explain wsgi changes

  bmschmidt

  committed
  dc1ec67

Commits on Apr 29, 2021

• Preliminarily working duckdb fetches. No build yet.

  bmschmidt

  committed
  29e060f

Commits on May 14, 2021

• Closer to DuckDB, interim patch

  

  Benjamin Schmidt

  committed
  fc04100

Commits on May 17, 2021

• Integrate nonconsumptive, ~50% passage of the old query API tests.

  

  Benjamin Schmidt

  committed
  52b8c66

Commits on May 24, 2021

• Refactorings

  bmschmidt

  committed
  a11204a

Commits on May 25, 2021

• Most tests fixed, one weird unicode problem remaining

  bmschmidt

  committed
  3d908e8

Commits on May 29, 2021

• Logging refactor, shift nc input expectations

  bmschmidt

  committed
  a552229

Commits on Jun 10, 2021

• Passes all existing tests!

  bmschmidt

  committed
  81fc5d9

Commits on Jun 18, 2021

• Align to nc

  bmschmidt

  committed
  e10b68e

• broken, waiting on upstream fix in duckdb

  bmschmidt

  committed
  bbedb0d

Commits on Jul 10, 2021

• Link to latest nonconsumptive version

  bmschmidt

  committed
  f0c7413

Commits on Jul 14, 2021

• full nonconsumptive integration

  bmschmidt

  committed
  86372e6

Commits on Jul 18, 2021

• Add API method to list all bookworms on endpoint

  bmschmidt

  committed
  fba5d49

Commits on Aug 2, 2021

• Change json standard to something more modern

  bmschmidt

  committed
  53ff321

Commits on Aug 3, 2021

• bigrams partially

  bmschmidt

  committed
  433d2fc

Commits on Aug 20, 2021

• Improved time handling

  bmschmidt

  committed
  e370fde

Commits on Sep 10, 2021

• Use duckdb to sort the big tables on ingest instead of custom sort routines.

  bmschmidt

  committed
  ec01df0

Commits on Sep 27, 2021

• Change sorting strategy to a more scalable version of quacksort

  bmschmidt

  committed
  3d785d6