2.10.3 raises AttributeError: partially initialized module 'airflow' has no attribute 'utils' (most likely due to a circular import) #43971

idexxbernvaug · 2024-11-13T17:16:01Z

idexxbernvaug
Nov 13, 2024

Hello!

I am trying to update Airflow to 2.10.3 from 2.10.2 to resolve a Dependabot finding, but I am getting these errors when trying to run my test suite, pasted below.

I am a little stumped, but maybe this is related to #43334 ?

I don't get these errors on 2.10.1 or 2.10.2

Any help to get things working again would be much appreciated. I am sure there is just a setting that I have missed.

I am using docker-compose with environment variables and not a conf file, and I confirmed that I am using:
AIRFLOW__DATABASE__SQL_ALCHEMY_CONN
instead of
AIRFLOW__CORE__SQL_ALCHEMY_CONN

Please let me know what info I can provide to help arrive at a solution.

==================================== ERRORS ====================================
________ ERROR collecting tests/unit/test_REDACTED_sort_order_operator.py _________
tests/unit/test_REDACTED_sort_order_operator.py:1: in <module>
    from plugins.hooks.aws_s3_hook import AWSS3Hook
plugins/hooks/aws_s3_hook.py:2: in <module>
    from airflow.providers.amazon.aws.hooks.s3 import S3Hook
/opt/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/site-packages/airflow/__init__.py:74: in <module>
    settings.initialize()
/opt/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/site-packages/airflow/settings.py:794: in initialize
    conf.mask_secrets()
/opt/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/site-packages/airflow/configuration.py:859: in mask_secrets
    value = self.get(section, key, suppress_warnings=True)
/opt/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/site-packages/airflow/configuration.py:997: in get
    warnings.warn(
E   FutureWarning: section/key [core/sql_alchemy_conn] has been deprecated, you should use[database/sql_alchemy_conn] instead. Please update your conf.get* call to use the new name

____________ ERROR collecting tests/unit/test_api_date_operator.py _____________
/opt/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/logging/config.py:93: in _resolve
    found = getattr(found, n)
E   AttributeError: partially initialized module 'airflow' has no attribute 'utils' (most likely due to a circular import)

During handling of the above exception, another exception occurred:
/opt/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/logging/config.py:543: in configure
    formatters[name] = self.configure_formatter(
/opt/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/logging/config.py:675: in configure_formatter
    c = _resolve(cname)
/opt/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/logging/config.py:96: in _resolve
    found = getattr(found, n)
E   AttributeError: partially initialized module 'airflow' has no attribute 'utils' (most likely due to a circular import)

The above exception was the direct cause of the following exception:
tests/unit/test_api_date_operator.py:1: in <module>
    from plugins.operators.api_date_operator import ApiDateOperator
plugins/operators/api_date_operator.py:1: in <module>
    from airflow.models.baseoperator import BaseOperator
/opt/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/site-packages/airflow/models/baseoperator.py:66: in <module>
    from airflow.lineage import apply_lineage, prepare_lineage
/opt/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/site-packages/airflow/__init__.py:74: in <module>
    settings.initialize()
/opt/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/site-packages/airflow/settings.py:785: in initialize
    LOGGING_CLASS_PATH = configure_logging()
/opt/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/site-packages/airflow/logging_config.py:74: in configure_logging
    raise e
/opt/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/site-packages/airflow/logging_config.py:69: in configure_logging
    dictConfig(logging_config)
/opt/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/logging/config.py:809: in dictConfig
    dictConfigClass(config).configure()
/opt/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/logging/config.py:546: in configure
    raise ValueError('Unable to configure '
E   ValueError: Unable to configure formatter 'airflow'
------------------------------- Captured stdout --------------------------------
[2024-11-13T16:42:26.500+0000] {logging_config.py:71} ERROR - Unable to load the config, contains a configuration error.

=========================== short test summary info ============================
ERROR tests/unit/test_REDACTED_sort_order_operator.py - FutureWarning: section/key [core/sql_alchemy_conn] has been deprecated, you should use[database/sql_alchemy_conn] instead. Please update your `conf.get*` call to use the new name
ERROR tests/unit/test_REDACTED_hook.py - KeyError: 'airflow'
ERROR tests/unit/test_api_date_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_api_datetime_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_api_get_records_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_api_pagination_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_api_record_count_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_api_result_to_s3_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_aws_s3_hook.py - KeyError: 'airflow'
ERROR tests/unit/test_categorize_record_updates_s3_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_create_or_replace_REDACTED_table_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_create_REDACTED_categorization_tables_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_create_REDACTED_stage_tables_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_create_REDACTED_stages_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_fail_on_upstream_failure_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_REDACTED.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_REDACTED_tables_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_REDACTED_columns_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_get_conf_param_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_get_path_with_xcom_args_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_get_s3_presigned_url_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_get_variable_data_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_get_xcom_data_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_identify_missing_s3_records_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_REDACTED_hook.py - KeyError: 'airflow'
ERROR tests/unit/test_REDACTED_endpoint_hit_multiple_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_REDACTED_endpoint_hit_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_REDACTED_messaging_email_send_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_local_excel_to_s3_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_local_filesystem_file_exists_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_lock_check_create_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_lock_remove_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_mft_file_delete_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_mft_file_exists_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_mimer_to_s3_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_ms_teams_webhook_hook.py - KeyError: 'airflow'
ERROR tests/unit/test_ms_teams_webhook_operator.py - KeyError: 'airflow'
ERROR tests/unit/test_REDACTED_hook.py - KeyError: 'airflow'
ERROR tests/unit/test_python_operator_common.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_REDACTED_hook.py - KeyError: 'airflow'
ERROR tests/unit/test_REDACTED_result_to_s3_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_s3_consolidate_file_lines_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_s3_delete_by_prefix_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_s3_delete_keys_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_s3_file_exists_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_s3_get_file_names_for_prefix_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_s3_json_string_to_csv_operator.py - KeyError: 'airflow'
ERROR tests/unit/test_s3_to_config_variable_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_s3_to_REDACTED_archive_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_s3_to_REDACTED_create_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_s3_to_REDACTED_update_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_s3_to_REDACTED_field_operator.py - KeyError: 'airflow'
ERROR tests/unit/test_s3_to_local_filesystem_operator.py - KeyError: 'airflow'
ERROR tests/unit/test_s3_to_s3_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_s3_to_REDACTED_create_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_s3_to_REDACTED_delete_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_s3_to_REDACTED_update_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_sas7bdat_to_s3_json_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_REDACTED_to_s3_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_REDACTED_copy_sql_query_to_s3_csv_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_REDACTED_execute_query_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_REDACTED_get_query_metadata_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_REDACTED_hook.py - KeyError: 'airflow'
ERROR tests/unit/test_REDACTED_merge_stage_into_live_table_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_REDACTED_tables_existence_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_REDACTED_to_s3_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_validate_convert_incoming_s3_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_validate_incoming_s3_bool_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/unit/test_validate_s3_file_columns_operator.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_bill_file_confirm_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_bill_file_to_REDACTED_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_billing_issue_orders_notfiy_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_invalid_manual_orders_notfiy_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_REDACTED_update_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_REDACTED_load_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_REDACTEDREDACTED_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_equipment_update_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_REDACTED_notification_config_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_REDACTED_notifications_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_REDACTED_notification_config_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_REDACTED_notifications_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_update_workitems_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_fail_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_execute_query_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_s3_file_clean_up_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_update_columns_config_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_update_columns_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_REDACTED_update_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_blocked_orders_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_accounts_tag_update_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_REDACTED_lookup_update_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_dbexport_config_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_dbexport_v2_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_messaging_send_email_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_tracking_update_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_REDACTED_to_REDACTED_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_api_to_REDACTED_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_to_REDACTED_compare_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_to_REDACTED_dag.py - ValueError: Unable to configure formatter 'airflow'
ERROR tests/dag_validation/test_REDACTED_to_REDACTED_data_compare_dag.py - ValueError: Unable to configure formatter 'airflow'
!!!!!!!!!!!!!!!!!! Interrupted: 100 errors during collection !!!!!!!!!!!!!!!!!!!
============================= 100 errors in 20.69s =============================

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

2.10.3 raises AttributeError: partially initialized module 'airflow' has no attribute 'utils' (most likely due to a circular import) #43971

{{title}}

Replies: 0 comments

Select a reply

2.10.3 raises AttributeError: partially initialized module 'airflow' has no attribute 'utils' (most likely due to a circular import) #43971

idexxbernvaug Nov 13, 2024

Replies: 0 comments

idexxbernvaug
Nov 13, 2024