Open Issues Need Help
View All on GitHub Inconsistent update of pipeline logs about 1 month ago
AI Summary: Improve the data pipeline's logging mechanism to prevent premature 'FAILED' status updates when the `fetch_data_api` function encounters exceptions. The solution involves either redirecting to a failure node after retry attempts are exhausted or handling exceptions inline, updating the log only after all retries fail. This ensures accurate monitoring and avoids false alerts.
Complexity:
4/5
good first issue