Elevate Your Debugging Process with Test Execution Log Diffs

Apr 1, 2024
3 mins
read
Bruno Lopes
Product Leader
Testkube
Read more from
Bruno Lopes

Table of Contents

Start your free trial.

Apr 1, 2024
3 mins
read
Bruno Lopes
Product Leader
Testkube
Read more from
Bruno Lopes
Bruno Lopes
Product Leader
Testkube
Today Testkube introduces the Test Log Analyzer to enhance your team's test debugging process using Text Execution Log Diff checker.

Table of Contents

Executive Summary

In the landscape of continuous software development and delivery, maintaining application reliability is crucial. To further our mission of enhancing testing your applications in Kubernetes, we are excited to introduce an awesome new feature to Testkube's Test Log Analyzer.

A couple of months ago we launched Log Highlights to further help teams debug their test logs.
Now we are continuing that goal by allowing you to easily compare test logs between different test executions.

Debugging Made Simple

Encountering a test that passes one day and fails the next is a common yet frustrating challenge. Identifying the root cause can be like searching for a needle in a haystack, involving a tedious comparison of logs, environment configurations, and more.

A Familiar Scenario: Effortless Regression Analysis

Consider the situation where a tester faces a sudden test failure after a series of successful runs. Traditionally, isolating the issue would require going through extensive logs and configurations manually, not an easy task.

Testkube's Test Execution Log Diff checker changes the game. This feature simplifies the debugging process, enabling you to quickly compare logs from a failed test run with those from successful test executions, highlighting what's important. It highlights discrepancies and pinpoints potential causes of failure, turning a time-consuming task into a swift and straightforward process.

How Testkube's Test Execution Log Diff Checker Works

Testkube's Log Diff checker uses sophisticated algorithms to parse through and compare execution logs from two test runs. It provides a detailed, side-by-side comparison that highlights differences between a successful execution and a failed one.

Testkube Dashboard showing a side-by-side test execution log diff between a passing and a failing k6 run

This direct comparison sheds light on changes between test runs, offering actionable insights to swiftly find issues and optimize your testing strategy.

Key Benefits

  • Accelerated Debugging: Quickly uncover the root causes of test failures.
  • Boosted Productivity: Reduce the time spent on debugging to focus on development.

Frequently Asked Questions

What is a test execution log diff?

A test execution log diff is a side-by-side comparison of the logs from two test runs, usually a passing run and a failing one. It highlights the lines that differ, so you can see exactly what changed between executions instead of reading both logs line by line.

How do I compare logs between two executions in Testkube?

Open an execution in the Testkube Dashboard and go to its log output. From there, choose another execution to compare against, such as the last successful run, and Testkube shows both logs with the differences highlighted.

How is Log Diff different from Log Highlights?

Log Highlights flags important keywords, such as errors and warnings, inside a single execution log. Log Diff compares two execution logs to show what changed between runs. Used together, they help you spot both the problem and the change that caused it.

When should I use a log diff to debug a failed test?

Use it whenever a test that used to pass starts failing, or when a test fails intermittently. Comparing the failing run with the last passing run quickly surfaces changes in output, configuration, dependencies or environment that point to the root cause.

Does log comparison work with any testing tool?

Yes. Testkube runs tests from any testing tool or framework inside your Kubernetes clusters and stores the logs for every execution, so you can compare runs no matter which tool produced the output.

Stop Wasting Time Debugging Logs and Get Started with Testkube!

Ready to eliminate debugging frustration? Get started with Testkube today and experience the power of intelligent log comparison. Need help along the way? Join our active Slack community where our team and thousands of developers share insights, troubleshoot together, and discuss best practices.

{{banner-get-started}}

Bruno Lopes
Product Leader
Testkube
Read more from
Bruno Lopes

About Testkube

Testkube is the open testing platform for AI-driven engineering teams. It runs tests directly in your Kubernetes clusters, works with any CI/CD system, and supports every testing tool your team uses. By removing CI/CD bottlenecks, Testkube helps teams ship faster with confidence.
Get Started with a trial to see Testkube in action.