Skip to content

We are pleased to announce the release of TestGrid Milestone 37

Pre-release
Pre-release
Compare
Choose a tag to compare
@yasassri yasassri released this 30 Jul 15:32
· 1151 commits to master since this release

We are pleased to announce the release of TestGrid Milestone 34

TestGrid provides enterprise customers with the confidence that the products and fixes they get from WSO2 are tested against all product scenarios against a wide-array of infrastructures and deployments, hence is production-ready.

Here’s what really happens in TestGrid:

image

  • Provision an infrastructure on AWS and other infrastructure providers via Infrastructure as Code (IAC) scripts. We use the IAC scripts provided by WSO2 for this purpose.

  • Do WSO2 product deployments on top the provisioned infrastructure. We do that by running Configuration -Management scripts (Puppet/Ansible) provided for WSO2 products.

  • Run JMeter/Selenium/TestNG scenarios against the deployment to certify the created deployment pattern against the given infrastructure combination.

  • In the end, Testgrid generates a report that shows the outcome of the scenario tests. All is good if it is green; start worrying if it is red! :)

With this release, TestGrid has following features & improvements:

  • Run WSO2-IS- integration tests via TestGrid for combinations of;
    -- OS: CentOS
    -- JDK: Oracle JDK
    -- DB: MySQL

  • Improved email template by adding summarize graphs and tables.

  • Test execution history graph: This graph represents the summary of previously executed build jobs.

  • Last build summary graph: This graph represents the summary of the last build.

  • Test failure summary table: This table represents the failed test cases against infra combinations.

  • Bug fixes and improvements

  • Real-time slack notifications for individual test plan failures

List of resolved features and issues can be tracked at :
https://github.com/wso2/testgrid/milestone/36

TestGrid has been tested against following infrastructures:

  • Cloud Provider: AWS and K8S-on-Openstack
  • Spawn instances with AMI images in any AWS region
  • Any database type AWS RDS supports (MySQL, MariaDB, PostgreSQL, SQL Server and Oracle)

Known Issues: https://github.com/wso2/testgrid/issues