Apollo Quality Management Phase II

Events

Build Process Governance / Release Management

Pre-deployment Release Readiness Checklist

November 1, 2017 - November 30, 2017

Carry over from Phase I.

Deliverables:
- Definition of a Release Readiness Checklist to be reviewed prior to hand over to Operations.

Tasks:
- Document Checklist template > Kurt
- Linked to upcoming deployments > Sally
- Implemented in Pre-Deployment scrums > Kurt

Deployment Process Enhancements

November 13, 2017 - December 12, 2017

Carry over from Phase I.

Deliverables:
- Ongoing enhancements to the Deployment Process.

Tasks:
- Document & present recommendations > Sally/Kurt
- Implementation of recommendations > Sally/Kurt

Recommendations:
- Pre-Build & Pre-Deployment scrums
- Upcoming Deployments form enhancements > Sally

Web Development Build Process Enhancements

January 1, 2018 - February 28, 2018

Deliverables:
- Target state definition (VSTS, release notes documentation, peer reviews, CI/CD automation, branching strategy, test case sign-off)

Tasks:
- Implement Proof-of-concept of VSTS with PBC > Mike/Kurt
- Document Branching strategy > Kurt/Vince
- Document Build workflow > Sally/Vince
- Provide training materials for Git to Developers > Kurt
- Provide demo of VSTS Build Def'n/Git branching to Developers > Vince/Kurt
- Release Notes Generation (Work items and commits in release notes - VSTS extension) > Vince/Kurt
- Code Commenting - DocFX > Vince

Mobile App Development Process

January 29, 2018 - February 27, 2018

Deliverables:
- Documentation of the build process for Mobile App Development > Ian
- Knowledge transfer of Mobile App Deployment Workflow > Kurt/Ian

Enhance QA Processes / Status Reports

Test Case and Automation Coverage

November 1, 2017 - December 31, 2017

Deliverables:
- Reporting of Test Case and Automation Coverage in QA Dashboard

Tasks:
- User Story / Test Case traceability report > Rashida
- Test Case Automation coverage report > Vince (code paths coverage - Azure Insights)

End of Project (Lessons Learned) Reports

November 1, 2017 - December 31, 2017
  • Develop Retrospect template > Rashida/Sally
  • Share with stakeholders > Rashida

Implementation of QA Run Book

November 20, 2017 - February 19, 2018

Post-Production Defect / Service Request​

November 20, 2017 - January 19, 2018

Quality Management Reports

December 1, 2017 - February 28, 2018

Deliverables:
- Quality Management Dashboard for stakeholders > Rashida/Ruslan
- Test Case and Test Automation coverage > Rashida/Rus
- ?

Mobile App Testing Framework

May 1, 2018 - July 31, 2018

Carry over from Phase I.

Deliverables: Documented test framework in preparation for Mobile App testing.

Analysis: Microsoft App Centre

Continuous Integration / DevOps Processes

Continuous Documentation

November 1, 2017 - April 30, 2018

Deliverables:
- DevOps Documentation Centre

Tasks:
- Set up Documentation Centre > Kurt
- Provide sections for Application-related documentation/knowledge (organized by Application) > Kurt/Sally
- Declaritive Comment Generation organized by Application (eg. Swagger) > Vince

Application Portfolio Evergreen

January 1, 2018 - February 28, 2018

Deliverables:
- Up-to-date Application Inventory

Tasks:
- Update existing fields > Sally
- Addition of new fields such as External Dependencies (eg. Reporting services RDL, file shares, 3rd party services), Operational Documentation, Configuration File Management, Baseline Performance tests) > Sally/Kurt

Integration Testing Framework

February 1, 2018 - March 31, 2018

Deliverables:
- Definition of Integration Testing Framework

Tasks:
- Implement framework for Integration testing (eg. validating Single Session Check, Caching verification) > Vince (Azure Insights)
- Document & present to team > Vince
- Incorporate into CI pipeline > Kurt
- Developer in Test role? > Anand

Code Analysis Automation

May 1, 2018 - June 30, 2018

Deliverables:
- Code Analysis built into CI/CI pipeline

Tasks:
- Evaluate code analysis tools to incorporate into pipeline (eg. sec > Kurt/Anand
- Implementation > Kurt

Sample tools:
- Checkmarx CxSAST
- Veracode

Data model change tracking - DB CI/CD

May 1, 2018 - October 31, 2018

Build Optimization

CI / CD implementation - Phase II

Mar 1, 2018 - April 30, 2018

Deliverables:
- Ongoing CI / CD enhancements

Tasks:
- Implementation of Build Process enhancements > Kurt
- CI/CD tools integration (eg. Test automation) > Kurt
- Check-in policies > Vince
- VSTS for CD (replace Octopus) > Vince/Kurt

Sample integrations:
- Jmeter performance tests
- Test Studio regression tests
- Selenium integration tests

Forms Deployment Automation

March 19, 2018 - May 18, 2018

Deliverables:
- Automation of Corporate Form deployments.

Tasks:
- Document workflow of Corporate Forms deployments (Forms Management Process) > Sally/Kurt
- Implement deployment of Corporate forms into Octopus Deploy > Kurt

Staging / UAT Environment

June 4, 2018 - September 30, 2018

Deliverables:
- Dedicated Staging / UAT environment tier

Operational Awareness

Post-Production Incident Reviews

December 15, 2017 - January 15, 2018

Deliverables:
- Post-Production Incident Reviews built into Operational processes.

Tasks:
- Incident Summary Report template > Kurt/Sally [Done]
- Implementation of Post-Production Incident Reviews > Kurt [Done]
- Traceability of Documented Reports > Kurt

Database Performance Monitoring

January 8, 2018 - February 7, 2018

Deliverables:
- Database query reviews/optimization.

Tasks:
- Definition of slow-running queries to report on > Kurt/DBA
- Implementation of periodic reviews of slow-running db queries > Kurt/DBA
- Plan for query optimization > Kurt/DBA

Application Performance Optimization

February 1, 2018 - February 28, 2018

Deliverables:
- Document Performance-Optimizing Design Patterns and present process for optimizing application performance to Development team > Vince
- Ongoing Load/Performance test result reviews (monthly) > Kurt

User Experience Monitoring

February 1, 2018 - September 30, 2018

Deliverables:
- User-centred response time monitoring

Tasks:
- Evaluation of UX monitoring tools
- Definition of base line response time triggers
- Implementation

Application Performance Monitoring

April 2, 2018 - October 1, 2018

Deliverables:
- Implementation of APM tools for ongoing application health monitoring

Tasks:
- Evaluation of APM tools > Vince/Kurt
- Proof-of-Concept: Implementation / Code refactoring to integrate selected APM tool (if required) > Vince