Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update vector ingestion #298

Open
wants to merge 3 commits into
base: dev
Choose a base branch
from
Open

Update vector ingestion #298

wants to merge 3 commits into from

Conversation

paridhi-parajuli
Copy link
Contributor

@paridhi-parajuli paridhi-parajuli commented Feb 19, 2025 •
edited
Loading

There are two dags veda-ingest-vector and veda-generic-ingest-vector that have the same handler.py.
This PR removes the redundant veda-generic-ingest-vector and performs some changes to the existing veda-ingest-vector dag.

Changes:

  • Modify the dag config.

For Non EIS data:

  • Update the code to pass and take extra flags when provided
  • Modify the code to take filename and id_template when collection is not provided in the dag conf

@paridhi-parajuli
1. Remove generic vector ingest dag
a44532a 
2. Add more dag configs
3. Modigy the ogr2ogr command
4. Take id template and filename for layername when collection is not provided
@paridhi-parajuli
remove generic vector ingest
896d718
@paridhi-parajuli
add default values
e9908c0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@amarouane-ABDELHAK amarouane-ABDELHAK amarouane-ABDELHAK approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@paridhi-parajuli @amarouane-ABDELHAK