In Keboola, a job represents the execution of a component within your project, whether triggered manually or automatically through a scheduled flow. Each job captures essential details, such as execution times, statuses, and configurations, providing you with complete visibility and control over your data operations.
Jobs in Keboola transition through various states, each indicating the current phase in execution. Understanding these states allows you to manage your workflows effectively:
Keboola maintains extensive job logs, sorted by descending execution time. These logs provide crucial insights and transparency into your data operations. You can view:
For instance, if the last executed job was a Google Sheets writer, the logs will show detailed information about who initiated it, how long it took, and its final status.
Job configurations offer detailed insights into the active processes within your project. By reviewing configurations, you can:
Keboola's intuitive interface provides basic and advanced filtering capabilities, allowing you to quickly locate specific jobs or groups of jobs. Filters include:
The ability to efficiently filter and navigate jobs significantly streamlines the monitoring and troubleshooting processes, saving you valuable time.
Keboola provides robust mapping of data inputs and outputs within each job. By clicking "Show All," you access detailed views of:
This comprehensive mapping helps you understand how data flows through your jobs, ensuring clarity in data lineage and dependencies.
Monitoring job durations is critical for improving performance and efficiency. Keboola clearly indicates how long each job took to complete, helping you identify long-running operations and potential bottlenecks. For example, if certain datasets consistently take longer to process, you can:
Importantly, Keboola displays the time taken specifically for data input and output from the workspace, aiding precise performance analysis.
Detailed job logs are invaluable for diagnosing issues and optimizing processes. Logs offer granular insights into what occurred during the execution process, highlighting:
By thoroughly reviewing logs, you can quickly identify and address issues, preventing future occurrences and improving overall workflow efficiency.
Consider a scenario where your marketing team regularly imports customer data from multiple sources and exports aggregated results to Google Sheets. By monitoring job logs, your team can easily verify:
Should issues arise, detailed logs highlight precisely where and why errors occurred, enabling rapid resolution.
Following best practices ensures maximum efficiency and effectiveness when managing your Keboola jobs:
Keboola's advanced job management features empower you to automate, monitor, and optimize your data operations seamlessly. By leveraging detailed insights and extensive logging, you can confidently handle complex workflows, troubleshoot effectively, and continuously improve your data processing efficiency.