Runscope API Monitoring    Learn More →

Posts filtered by tag: continuous integration

Tutorial: Continuous Integration with CircleCI and Runscope API Tests

Tutorial: Continuous Integration with CircleCI and Runscope API Tests

By Heitor Tashiro Sergent on .

CircleCI is a popular Continuous Integration and Delivery solution (used by Facebook, Kickstarter, Spotify), and integrating it with Runscope Trigger URL tests so you can run your Runscope API tests takes only a few minutes!
Runscope can be used by itself to monitor and test APIs, but it can also be used as part of your CI workflow. We have a sample Python script in our GitHub that can be used to trigger a set of tests in your Runscope account, and change the build status based on their results.
In this tutorial, we're going to show you how to use that script with CircleCI. We'll cover...

Read More →

Categories: code samples, tutorial, testing, integrations

Tutorial: Continuous Integration with Codeship and Runscope API Tests

Tutorial: Continuous Integration with Codeship and Runscope API Tests

By Heitor Tashiro Sergent on .

A part of an engineer's toolbox is a good automation workflow. One of the tools in that box is a Continuous Integration provider, which can help teams prevent integration problems and improve quality control.

Runscope can be used by itself on running and monitoring APIs, but it can also be used as part of your CI workflow. Our CEO, John Sheehan, created a sample Python script that can be used to trigger a set of tests in your Runscope account, and change the build status based on their results.

In this tutorial, we're going to show you how to use that script with Codeship. We'll cover how...

Read More →

Categories: code samples, tutorial, testing, integrations

Harness the Power of PUT & POST: Fully Automate Your Workflow with the Updated Runscope API

By Stephen Huenneke on .

At Runscope, we don’t just love helping developers solve API problems—we’re passionate about APIs across the board. We built Runscope so that you can test any API, from REST to SOAP to everything in between, successfully. Internally, we rely on more than 60 APIs and microservices to power our infrastructure. It’s with that passion that we’ve been working on some major additions to the Runscope API in response to the valuable feedback that you’ve provided about how you want to use Runscope in your organizations.

Today we’re excited to announce the official release of the newly improved and updated Runscope API. This update allows you to fully integrate Runscope into your workflow, and manage tests, environments and schedules programmatically.

The Runscope API is available to all Runscope customers, and you can access your API keys in your Runscope profile under Applications. The updated API gives you the power of Runscope at your fingertips, providing you with complete control over API test automation and management. 

Building a Better Runscope with Your Feedback

We’ve had the Runscope API available to customers since we launched Runscope in 2013, and Runscope has come a long way since then. The original Runscope API was read-only and built as a way to upload custom recorded traffic, and gather test result data and information about your teams, which served the Runscope product well at the time.

However, today’s Runscope looks much different than it did two years ago: You can now reuse API tests across multiple environments, test APIs from locations around the world, import tests from Swagger definitions, run browser tests in parallel, integrate with Slack and Datadog, plus so much more. We wanted our API to be just as robust, if not more so, than Runscope itself.  

Our focus has always been on the feedback you’ve given us that relates to your most pressing needs. For the most part, these requests have included tooling around novel and advanced configurations, as well as broader monitoring and testing capabilities across locations and environments. With these cornerstone features in place, we've been able to round out the Runscope API’s functionality after months of work and testing behind the scenes to provide you with a fuller, richer API that powerfully extends your ability to use Runscope across any use case in parity with the web interface.

What’s New: Test Automation and Management at Your Fingertips

The Runscope API has been updated to include nearly every capability you have in the Runscope UI, plus several major new features to help you work quickly across teams with less hassle. The API is RESTful and communicates with JSON-formatted data. By leveraging the updated Runscope API, you can mold Runscope to your unique needs without having to traverse the UI, along with the following key additional features:

  • Automate: Streamline operations and save hours of work by programmatically creating and auto-generating complex tests across multiple APIs and services.  

  • Write in bulk: Solve large-scale test management pains with the ability to create and delete multiple tests at the same time. You can also leverage the search and replace function to find and remove pieces of a test fast.

  • Import: Save hours of work you’ve already done building API definitions with schemas like Swagger and instantly turn them into Runscope tests.

  • Modify: In one easy step, modify entire tests, environments and schedules faster than ever.

  • Streamline: Build advanced tests with ease by adding condition steps, pauses and integrations with browser tests in Ghost Inspector.

  • Integrate with CI and CD: Connect Runscope tests and schedules seamlessly into your continuous integration (CI) and continuous deployment (CD) processes. Implement chained requests and trigger URLs so that your CI process not only kicks off a test, but also updates the test before it begins.

  • Store: Protect your work by backing up your data and storing it through the API.

Check out the Runscope API docs to learn how you can implement all of the above functionality in your organization. If you are already familiar with Runscope, then the docs will be a breeze to look through.

Sample Apps and More to Get You Started

In our API sample app repo, there are two Python apps we’ve built off the Runscope API that you can use immediately that showcase the simplicity of writing and backing up tests. We've also created an API Explorer in which you can tinker and make live API calls instantly. We’ll continue to add more apps for you, and we encourage you to build your own and tell us about it!

1. Create Tests

We’ve made building new API tests a snap via the updated Runscope API. With this app, you can learn how to create tests programmatically without having to go into the Runscope Dashboard UI. This app has a couple of sample tests in JSON that you can import directly into your Runscope account to run immediately.

2. Backup Tests

You’ve spent the time and effort creating robust tests for the variety of use cases and APIs in your stack—wouldn’t it be great if you could download and back them up? With the new Tests resource, you can fetch test configurations and store them outside of Runscope itself. This functionality gives you more flexibility for managing your tests.

This app traverses all of your buckets, fetches every test and saves them in time-stamped buckets. Take a snapshot of a representation of your tests for backup and versioning, and use the Runscope API to POST a copy to a new test, or PUT an update over an existing test.

3. Runscope API Explorer

If you’re the hands-on type of developer who likes to tinker and read the docs later, try out the Runscope API Explorer. Traverse through the resources and methods, and when you’re ready, just go through the OAuth flow and start making live API calls.

NOTE: There are several API methods that can overwrite and delete your existing test configurations. We highly recommend that you use a sandbox account or create a sandbox bucket while you’re learning to use the API and building/testing apps. In fact, maybe it’s a good time to use the sample app above and backup all of your test and environment configuration data!

Take It for a Spin

We are committed to producing more sample apps that showcase the power of the Runscope API, and we want to see what you build with it too! The Runscope API is available to anyone who uses Runscope, and you can sign up for free in just a few seconds. Did you build a cool tool that you’d like to share with the Runscope community? Tell us about it in the comments below so we can showcase it on the blog, or add to our GitHub repo of examples.

Categories: apis, announcements, integrations, product

Integrate Runscope and Ghost Inspector Tests with AWS CodePipeline

By Ryan Park on .

Continuous Integration (CI) and Continuous Deployment (CD) are software development practices that can help to detect problems early and improve productivity. In a typical CI/CD workflow, each time a developer checks in code, the project is automatically built, tested and deployed. If your project relies on APIs, or is an API itself, integrating functional API tests as part of your CI/CD workflow can insure that your web services are fully functional with your latest code push. Likewise, if your project is a web application, including browser tests as a step in your CI/CD pipeline can help to detect UI problems introduced with your last commit.

AWS CI/CD Solution: CodePipeline

We’re excited to announce that we’re integrated into the new AWS CodePipeline product which was made available to customers today at AWS Summit NYC. AWS CodePipeline is a continuous delivery service that enables you to model, visualize and automate the steps required to release your software. Customers of CodePipeline can include Runscope API tests and Ghost Inspector browser tests in their continuous delivery pipelines to catch faults and regressions early in their development processes.

With CodePipeline, you model the full release process for building your code, deploying to pre-production environments, testing your application, and releasing it to production. CodePipeline then builds, tests, and deploys your code as modeled every time there is a code change. You can integrate partner tools and your own custom systems into any stage of the release process to form an end-to-end solution. CodePipeline enables you to rapidly deliver features and updates with high quality through the automation of your build, test, and release process.

Many of you with CI/CD workflows in place have already integrated Runscope tests into their pipeline, like uShip and SendGrid. For those users looking for a CI/CD solution, CodePipeline can streamline those processes even more with direct pipeline integration of your Runscope and Ghost inspector tests.

Easy Test Integration from the AWS Console

The CodePipeline visual configuration makes it easy to visualize your build, test and deploy flow. In the screenshot above, the pipeline has three steps. In the first step (Source), the source code is obtained from an AWS S3 bucket. In the second step (API Testing), a Runscope API test is initiated. In the last step (Browser/UI Testing), a Ghost Inspector browser test runs. Adding a Runscope or Ghost Inspector test to your pipeline is as simple as few clicks.

For more information about AWS CodePipeline, click here. If you have any other questions about Runscope or Ghost Inspector, or how to integrate your tests into your CI/CD workflow, contact our support team. Check out the full announcement for more information about the integration. 

Categories: announcements, ghost inspector, integrations, product, testing, monitoring

Continuous Integration, Deployment and Testing of Your Web APIs with AppVeyor and Runscope on Azure

By Neil Mansilla on .

Runscope developer advocate Darrel Miller shares a step-by-step instructional blog post on how to integrate AppVeyor (CI tool on Azure) with Runscope to accomplish rock-solid API testing.

Photo by Alex Eylar:

Photo by Alex Eylar:

Fast iterations can be very valuable to the software development process, but make for more time spent doing deployments and testing. Also, more deployments means more opportunities to accidentally introduce breaking changes into your API.

AppVeyor is a cloud based continuous integration server and Runscope enables you to do integration testing of your Web APIs, when these services are combined they can save you time doing the mechanical stuff and ensure your API consumers stay happy.

The following steps show the key points to achieve this integration using AppVeyor, Runscope and Azure websites.

Read the rest of Darrel's post...


Categories: howto, apis, testing

Everything is going to be 200 OK®