263 feature add postgres and s3 support in the helm chart

[akhileshsharma99]

• throughput
• fixed engines
• engines suck
• rapid ocr 1 engine
• rm csvs
• new rapid ocr deployment
• updated rapid ocr
• new rapid ocr deployment
• fixed seralization error
• new rapid ocr deployment
• new deployments
• new analytics
• markdown tables fixed
• mkd down fix deployed
• testing changes
• Service down header removed
• Update README.md
• Update README.md
• Added github star and fork count to header
• Removed console.log
• new deploy
• new deploy
• pre apply discounts
• deployed
• Cahnges to github redirect button
• better logs
• new deploy
• new deploy: libreoffice fix
• deployment: github icon
• Small fix for header spacing
• adding github repo info
• removed pritn statements
• frontend updated
• deployed: github info with token
• page limits added
• fixed trigger
• deploy: page limits & discount bug fixes
• edits to usage
• Changed hardcoded limit values for fast and high quality on dashboard
• deploy
• deploy
• updated example secret
• updated self deployment
• updates
• adding paddle
• sends request
• updates
• bruh
• table ocr v1 done
• new table ocr
• adding compose.yaml
• cleaning up local dev
• compose yaml updated:
• issues with task expiration fixed
• postgres errors
• working on postgres migration errors
• works
• server working
• updated env
• updated env
• auto downloading pdfium binary works
• Update README.md
• wokring on pdla errors
• segemetation working locally
• wokring on table ocr
• testing options
• adding llm ocr
• working on LLM models
• added structured extraction
• uncooking merge errors
• rm unused code
• server - structured extract done
• done struc extract
• added kube for embeddings
• docker and kube for struc extract
• added structured extract to ocr off
• docker and kube for struc extract
• docker and kube for struc extract
• docker and kube for struc extract
• docker and kube for struc extract
• docker and kube for struc extract
• new dev deploy
• added structured extract to ocr off
• new kube for tei
• new ports
• done struc
• Frontend fixes for new output object
• cleaned up struc extract code
• docker and kube for struc extract
• updaing pyscripts
• updated pyscripts
• model updated
• hueristic for hallucinations
• cleanup
• cleanup
• new deployment
• merged properly
• updated pyscripts
• done with testing
• added paddle service
• added paddle service
• done with paddle docker
• docker compose updated
• deploy: web
• new prompts
• quality fixes structured extract
• new deployment
• updated pyscripts
• deploy: web
• table recognition working
• updated compose.yaml
• ocr done
• html to mkd v1
• html to mkd v1
• colspan works
• mkd done
• deploying new ocr
• deploying changes
• adding external s3 client to work with docker compose
• adding external s3 client to work with docker compose
• docker compose updated
• updated envs
• specfic dockers for different ocrs
• specfic dockers for different ocrs
• updated
• updated
• paddlex pipeline not working for table
• paddle proxy working
• added proxy to ocr services
• fixed glibc version error
• updated
• updated kube with proxy
• updated kube probe
• adding error handling in html to mkd
• deploy html fix
• ocr worker html safety
• fixing local dev
• new prompts
• quality fixes structured extract
• compose with vllm added
• updated
• kube experimental added
• readme updated
• updated readme
• updated readme
• updated readme
• updated readme
• updated readme
• Update README.md
• :wq Wq added stuff to prompt fot table ocr
• updated readme
• added .env.example
• updated LLM key in example.env
• added readme
• docker compose
• rm segmentation
• structured extract local works
• structured extract local works
• rm test
• new model
• very fast structured extract
• changes to configs
• configs updated
• added vllm support for tables
• updated table ocr
• updated prefix
• updated compose
• VLLM ocr works
• VLLM ocr works
• refactor
• table ocr with validation bangs
• works
• including prompts in binary
• formula prompt added
• tested
• added throttle limits
• cleaning up openai response
• cherrypicked
• experimental kube updated
• removed host rules
• bruh
• idk
• merged new seg strat
• merged table ocr with structured extraction
• built dockers and updated kube for tag d8eba61: cmd,fast,ocr,high,gen-ocr,post,pre,struc,table-ocr
• done
• done
• search config
• new kube
• filter out empty chunks
• new kube
• prompt and default value changes
• prompt and default value changes
• new cube
• updated openai call
• working on proxy
• using redis for rate limits
• compose changes
• leaky bucket rate limiter added with redis
• minor bug fixes
• minor bug fixes
• minor bug fixes
• paddle ocr test added
• rate limits implemented
• bugs
• deployment: rate limits
• deployment: rate limits
• kube
• bug fix
• table test
• added doctr service
• doctr inference server created
• adding doctr as ocr option
• doctr ocr done
• create new dockers
• docker not working
• fixed doctr docker
• deploy: doctr ocr
• deploy: doctr ocr
• new dockers
• doctr update
• doctr update
• doctr update
• doctr cant get nvidia drivers
• bulding docker with gpu
• new dockerimage for doctr
• new env example
• new secrets
• removed rrq message
• new sha
• added redis url
• rebasing
• testing more tables
• ocr integrated
• tested locally
• new kube for llm table ocr
• updated readme
• updated readme
• updated readme
• new kube for llm table ocr
• new kube for llm table ocr
• timeout issue
• ocr html validation removed
• new kube
• table ocr now fails on ocr error
• new docker build
• rrq timeout increase
• new dockers
• rebuild dockers
• Fixed formula rendering for html and markdown in viewer
• Final fixes
• presigned url headers
• compose
• new dockers and kube for pdf signed url
• removed dompurify
• deploying formula support on web
• Update compose.yaml
• page llm ocr
• tweaks to page prompt
• tweaks to page prompt
• view window
• tweaks to page prompt
• kube for page llm
• updated session timeout
• docs(README): fix incorrect git URL
• updated docker compose to use paddle ocr
• added comments
• page llm ocr
• tweaks to page prompt
• tweaks to page prompt
• view window
• tweaks to page prompt
• kube for page llm
• updated session timeout
• docs(README): fix incorrect git URL
• Update compose.yaml
• updated compose.yaml
• segmentation strategy:
• new redoc
• Fixed table colspan rowspan rendering
• terraform for azure
• renamed kube files to share across providers
• deleted old gcp kube - deprecated
• not required for internal communications
• removed backend config as that is only needed for ingress
• adding support for cloudflare tunnel
• cloudflare dns for tunnel and dns records
• cloudflare removed dsn records
• removed cloudflare terraform
• adding helm support
• added helm support for all the services with templates
• set up secrets for helm and internal communications
• updated shared secrets
• added readmes
• debugging
• adding redis to kube
• removed redis from terraform for azure
• added gpu support for embeddings
• added ngnix setup instructions
• adding cloudflare tunnel support
• cloudflared tunnel works
• updated envs
• kubernetes on azure
• clean up
• updated container name
• recovered gcp-experimental
• web bug fixes
• increase max nodes on azure
• adding postgres support
• renamed
• added postgress support with init db
• added local filesystem support for s3
• fixed bugs
• postgres permission issues fixed
• added pvc to redis, postgres and s3
• s3proxy works with azure blob storage