Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test TestLocalExecutor.test_execution(unlimited) sometimes fail #45329

Open
potiuk opened this issue Jan 1, 2025 · 0 comments
Open

Test TestLocalExecutor.test_execution(unlimited) sometimes fail #45329

potiuk opened this issue Jan 1, 2025 · 0 comments
Labels
area:Executors-core LocalExecutor & SequentialExecutor Quarantine Issues that are occasionally failing and are quarantined

Comments

@potiuk
Copy link
Member

potiuk commented Jan 1, 2025

The test sometimes fails:

=================================== FAILURES ===================================
_________________ TestLocalExecutor.test_execution[unlimited] __________________
tests/executors/test_local_executor.py:114: in test_execution
    self._test_execute(parallelism=parallelism)
/usr/local/lib/python3.11/unittest/mock.py:1378: in patched
    return func(*newargs, **newkeywargs)
tests/executors/test_local_executor.py:91: in _test_execute
    executor.end()
airflow/executors/local_executor.py:230: in end
    proc.join()
/usr/local/lib/python3.11/multiprocessing/process.py:149: in join
    res = self._popen.wait(timeout)
/usr/local/lib/python3.11/multiprocessing/popen_fork.py:43: in wait
    return self.poll(os.WNOHANG if timeout == 0.0 else 0)
/usr/local/lib/python3.11/multiprocessing/popen_fork.py:27: in poll
    pid, sts = os.waitpid(self.pid, flag)
E   Failed: Timeout >60.0s
----------------------------- Captured stdout call -----------------------------
[2025-01-01T13:45:44.503+0000] {local_executor.py:60} INFO - Worker starting up pid=288
[2025-01-01T13:45:44.519+0000] {local_executor.py:60} INFO - Worker starting up pid=290
[2025-01-01T13:45:44.523+0000] {local_executor.py:215} INFO - Shutting down LocalExecutor; waiting for running tasks to finish.  Signal again if you don't want to wait.
[2025-01-01T13:45:44.525+0000] {local_executor.py:96} ERROR - uhoh
Traceback (most recent call last):
  File "/opt/airflow/airflow/executors/local_executor.py", line 92, in _run_worker
    _execute_work(log, workload)
  File "/opt/airflow/airflow/executors/local_executor.py", line 113, in _execute_work
    supervise(
  File "/usr/local/lib/python3.11/unittest/mock.py", line 1124, in __call__
    return self._mock_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/unittest/mock.py", line 1128, in _mock_call
    return self._execute_mock_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/unittest/mock.py", line 1189, in _execute_mock_call
    result = effect(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/airflow/tests/executors/test_local_executor.py", line 71, in fake_supervise
    raise RuntimeError("fake failure")
RuntimeError: fake failure
[2025-01-01T13:45:44.527+0000] {local_executor.py:60} INFO - Worker starting up pid=305
[2025-01-01T13:45:44.564+0000] {local_executor.py:60} INFO - Worker starting up pid=318
[2025-01-01T13:45:44.580+0000] {local_executor.py:60} INFO - Worker starting up pid=297
------------------------------ Captured log call -------------------------------
INFO     airflow.executors.local_executor.LocalExecutor:local_executor.py:215 Shutting down LocalExecutor; waiting for running tasks to finish.  Signal again if you don't want to wait.
----------- generated xml file: /files/test_result-core-postgres.xml -----------

For example https://github.com/apache/airflow/actions/runs/12571140824/job/35041860269#step:6:2934

@potiuk potiuk converted this from a draft issue Jan 1, 2025
@potiuk potiuk added the Quarantine Issues that are occasionally failing and are quarantined label Jan 1, 2025
@dosubot dosubot bot added the area:Executors-core LocalExecutor & SequentialExecutor label Jan 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:Executors-core LocalExecutor & SequentialExecutor Quarantine Issues that are occasionally failing and are quarantined
Projects
Status: Flaky stuff
Development

No branches or pull requests

1 participant