Skip to content
  • There are no suggestions because the search field is empty.

JOSF

The JOSF integration lets you import automated test results directly into TestMonitor.

About JOSF

JOSF is a low-code test automation framework designed for testers and developers who want to automate tests with minimal technical complexity. Its intuitive UI enables fast creation of reliable, maintainable test cases.

Features

The JOSF integration supports:
  • Creating JOSF test cases, along with their associated results and execution run in TestMonitor.
  • Identification of previously uploaded JOSF test cases, enabling you to submit multiple execution runs over time.
  • Uploading of test run artifacts, such as screenshots.
  • Configuration of imported test case placement and milestone behavior.

Prerequisites

Before you begin, ensure you have:
  • Admin or project manager role in TestMonitor
  • JOSF version 3.3.4 or newer installed
  • A JOSF Pro license (request access via hello@josf.io)

When all these requirements are met, you can proceed with setting up the JOSF integration.

Activate the JOSF Integration

Activate the JOSF integration for your project as follows:

  1. Go to the Project Settings.
  2. Choose the Integrations option from the menu on the left.
  3. In the top right corner, click on Browse....
  4. Find and select the JOSF panel.
  5. Select the Activate button to enable the JOSF integration.
  6. Optionally, select the Default milestone for your JOSF test runs.

Configure JOSF

To submit your test results using the JOSF integration, you need to configure TestMonitor in your JOSF settings and update your Playbook settings. Follow the instructions in this JOSF knowledge base article to complete these configuration steps.

Your daily submission quota is determined by your subscription plan: Starter allows up to 500 results per day, Professional up to 2,500, and Enterprise up to 5,000. Additionally, submissions are limited to a maximum of 10 per minute.

View and Analyze JOSF Results in TestMonitor

Once the results have been submitted, the reporter will generate a URL that enables you to access and review the Playwright test results.

You can access a comprehensive overview of all JOSF test runs in the Track test runs section:

  1. Go to Track
  2. Open the filter dialog by clicking the icon.
  3. Identify and select the Reporter filter, then proceed to close the filter dialog.
  4. Activate the Reporter filer and select JOSF from the list.

Deactivate the JOSF Integration

If the integration is no longer required or your project comes to an end you can easily deactivate the integration:

  1. Go to the Project Settings.
  2. Choose the Integrations option from the menu on the left.
  3. Select the JOSF panel.
  4. In the top right corner, click on Deactivate... .
  5. Click Deactivate to confirm.

Deactivating the integration will halt the submission of any future automated tests.
All submitted test cases, test runs, and results will continue to be accessible within your project for your review and analysis.

Troubleshooting

If you encounter errors involving the JOSF integration with TestMonitor, here are some steps you can take to troubleshoot the issue:

Confirm your domain and token are correct

Verify that your JOSF configuration includes the correct domain and token, as specified in your integration settings on TestMonitor.

Check your daily submission quota

Ensure you have not exceeded your daily submission quota. Submission limits are based on your subscription plan: Starter permits up to 500 results per day, Professional up to 2,500, and Enterprise up to 5,000. Additionally, a maximum of 10 submissions per minute is allowed.

Inspect the integration log

The integration log assists in identifying the reasons for integration failures by listing all encountered issues while interacting with JOSF. To access the log, follow these instructions:

  1. Open the integration page
  2. Click on the link in the right panel that reports the number of integration issues.

Investigate the log entry by reviewing the error type and description. You can dismiss the error by clicking on the check button on the right.

Refresh your integration token

If you continue to experience authentication errors, it is advisable to refresh your integration token to confirm that you are using the correct credentials.

  1. Click on the three-dotted menu in the top-right corner.
  2. Select Refresh token...
  3. Confirm your action.
  4. Ensure that you revise your JOSF configuration to use the updated token.

Contact support

If these solutions do not resolve your issue, feel free to reach out to our support team for additional assistance.