The Testgram Manifesto

Web testing,
from first principles.

We've tested our webapps the same way since the day the internet was invented. So we started from scratch to build it our way.
Here are our motivations. This is the why to Testgram.

The answer is almost never "more testing".

In a world where rapid delivery is the key to success, value is realized once the product is in the user’s hands. Production deployments deserve to be celebrated but we are too often left to clean up the aftermath. The slightest defects in a deployment can have a detrimental impact on user experiences and reflect negatively on our brands. Time and resources will always be limited and the emphasis will always be on delivery. We beg the question, how do we deliver a perfect deployment?

We believe for a vast majority of companies, the answer is never to test more, but to test the right things at the right time. In the Web 2.0 world, we're compelled to provide a data driven answer to these questions.

We're obsessed with the entire product lifecycle.

Our mission is to help you test for the moments that matter.

We realized that great software isn't just a function of great testers or great developers. Rather, great software is a natural output of an organization's obsessive focus on user experience and value. It requires every single person and every action to be guided by the same compulsion.

We believe that the approach to testing today diverges from a fundamental goal of testing: to test the product as a user would use it.

To close the gap between testing and usage, our team at Testgram is building a next generation test intelligence platform that empowers your team to leverage real usage and behavior data to make better product, engineering, and testing decisions.

Start and end with real users

We test because we want to mitigate risk for our real users. Testgram is built to help you tie every product, engineering, and testing decision back to a robust measure of user-driven risk and value. We believe the right things to spend our time and energies testing are the things that our users really care about.

A pipeline process, not a pre-release ritual

Testing needs more love. Today, testing is often considered the final step in the development lifecycle before we release. 

The longer a bug exists, the more expensive it becomes. Bugs cost 40x more in production than they do the day before in pre-production environments, and 15x more in UAT than they do in the developer's local developments.

With the pace and scale of modern web applications, testing needs to be a continuous effort. Testgram is built from the ground up to deliver continuous feedback to your developers with minimal intervention so that you can scale your QA without adding a mountain of work.

Measure everything, always

Testing needs a meter stick. All successful initiatives are measured based on repeatable and rigorous metrics so at all times you know where you're at, where you need to be, and where you need to spend more time. We couldn't seem to find that sort of metric in our industry, so we decided to come up with our own: the Testgram Coverage Score.

It's the first behavior driven testing KPI. Our platform uses this KPI to proactively guide your testing practices to mimic the behaviors your application sees in the wild. It's where our name comes from too: 
Test(gram) : [noun] a metric unit to measure testing.

Design for change

Applications need to be constantly changing to keep up with changing markets, customer requirements, and feature additions. A fundamental problem with automation today is that as our applications change, we have to adapt our automation to keep up. Effectively, we have to do the work twice.

We built Testgram with change as a core tenant. Testgram automatically adapts and versions the automation it creates so that as your application changes, your testing is always working without any additional work. If we can't adapt, we'll let you know you until we can automate it again.

Design for scale

Modern web application frameworks like React, Angular, Vue, and .NET are built with scale in mind and enable rich interactions with our products. With their advent, our products have become more complex, making them harder to test as they grow and scale.

Testgram is a cloud native application built for the modern web. We process and learn from trillions of events per second. We even built our own test runner to be able to efficiently execute thousands of your tests in our stack at a fraction of the time, all so that we can be confident that we'll scale to meet the needs of your product tomorrow.

Continuous augmentation

At Testgram, we want to build automation so that people don't have to be the automation. Testgram is great at identifying, automating , and testing existing functionality so that we can free up your QA resources to battle test new features. Testing will always require humans, we're focused on making their lives easier.

Testgram works with your team every step of the way to deliver superhuman defect discovery speeds.

Prioritize human attention

UI testing today is fundamentally bottlenecked by human attention. Modern applications are built for scale with thousands of interaction patterns, behaviors, and uses. We believe humans should focus on higher order testing: connecting intuition with expectation. We can handle the rest.

Testgram is built to uncover the most important actionables at any given moment so that you know you're making the most impactful decisions through your product lifecycle.