SOASTA

CloudTest, SOASTA's web and mobile app platform enables developers, QA professionals, and IT ops teams to test with speed, scale and precision.

SOASTA Evaluation Score
1. Setup & Configuration

Unlike their competitors who offer a free trial version with no signup requirements, SOASTA's signup process for their "CloudTest" software requires both signup and email instructions. The installation is lengthy and requires multiple downloads and configurations.

C

2. Scalability (In)

SOASTA licensed version can be scaled to sufficiently large numbers. I was able to run a test of 5000 concurrent users with SOASTA. Multiple server machines however are required to drive the load of larger number of users.

A

3. Scalability (Out)

SOASA enables unlimited global testing. Testing across different geographical areas can be performed and the analytics tool can be used to analyze the results across different areas

B

4. Scope

SOASA provides a separate tool for testing mobile devices. However SOASTA's support to different types of applications is limited. Supports only HTTP, Flash and Web services.

F

5. Scripting & Recording
SOASTA provides a rich GUI scripting interface. Scripting in case of SOASTA is slightly different that the 'record and playback' mode of scripting as is observed in most of the tools. This is the reason why it takes slightly longer to learn scripting in SOASTA

B

6. Integration
Apart from the tools provided by the SOASTA team, it can't be integrated with others available in the market. However integration with tools like the analytics tool is quite easy and seamless.

B

7. API Capabilities

API testing can be very easily performed - either by recording the scripts and updating them to include the API requests or by writing the API scripts directly. Excellent API testing capabilities.

A

8. Software Maturity & Reliability
Results when compared with similar tests performed using other tool, were close to that with other tools. Hence the results can be called reliable. Software is new in the market and for any issue with the tool it takes time for resolution. Also User community is not very well developed hence very less support on user forums.

C

9. Ease of Switching
SOASTA is easy to learn tool and is also called as developers tool. Developers find it easy to learn. Performance testers have also shown quick learning.

B

10. Price & Total Cost
Compared to other cloud testing tools available in the market SOASTA's cost is comparatively higher. For some tests that we performed, we executed a test of 2000+ concurrent users and were charged more than USD 10K.

E

11. Support & User Community

The SOASA forums are useful for interacting with the team, but the community is relatively small. Although there is a lot of documentation, it is very unorganized, in many formats (PDF, video, screenshots, and word docs), and often difficult to find.

E

Have a question or comment? Add your thoughts to the Comments below. Click here to go to the next page .