Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add startTime to paginator.paginate when fetching logs in GlueJobHook #46950

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

rawwar
Copy link
Collaborator

@rawwar rawwar commented Feb 21, 2025

refer to the issue for a detailed discussion
fixes #44694

@boring-cyborg boring-cyborg bot added the provider:amazon AWS/Amazon - related issues label Feb 21, 2025
@rawwar rawwar requested review from ferruzzi and vincbeck February 22, 2025 04:35
Comment on lines +250 to +251
(datetime.now() - timedelta(hours=24)).timestamp() * 1000
), # 24 hours ago in milliseconds
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can definitely have an instance variable within hook that we can use to across as a startTime. Not really sure if we should hard code this. But, open to ideas.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
provider:amazon AWS/Amazon - related issues
Projects
None yet
Development

Successfully merging this pull request may close these issues.

GlueJobOperator stuck in running state, even when the job is completed on AWS, when Verbose=True
1 participant