Sprint 40 review

ManageIQSprint 40 Review - Sprint End May 9, 2016Darga StabilizationMay 11, 2016

Overview● Sprint Statistics (Oleg Barenboim)● Providers (G. Blomquist)● User Interface (D. Clarizio)● Platform (Gregg Tanzillo)● REST API (Alberto Bellotti)● Automate (Greg McCullough)● Performance (Dennis Metzger)● Discussion

Sprint Statistics(O. Barenboim)

330 Pull Requests MergedOut of 183 Bugs, 172 were Darga backports

Darga Backports(O. Barenboim)

269 Darga Backports172 Darga Backports that are Bugs

PR Breakdown by Feature Category (O. Barenboim)

* Note that some PRs have more than one category.

Providers

Sprint Comparison (O. Barenboim)

All Repo Stats (O. Barenboim)

Data source:

https://github.com/ManageIQthese are listed by most recent activity. go into each one that has been updated in the past 20 days and add up the PRs that have been merged

Order descending by #PRs merged

Repository PRs Merged

manageiq 330

ansible_tower_client 2

azure-armest 3

guides 1

manageiq_docs 1

manageiq-appliance 4

manageiq-appliance-build 6

manageiq-ui-self_service 7

manageiq.org 5

ovirt 3

ovirt_metrics 2

virtfs 1

Total 363

https://github.com/ManageIQ

https://github.com/ManageIQ

http://manageiq.org

http://manageiq.org

Darga● Release Candidate this week● Sprint 41 = Darga Final Stabilization● Darga Release scheduled in June● Look for Talk Topic for Vote to Name E Release

Providers (G. Blomquist)


Enable / Disable cloud services

Make Keystone V3 Domain ID Configurable


Volume claims


Events!

Better OS identification for VMs


Distributed Switch Inventory

Providers - Middleware/Hawkular (A. Bonas)

Sprint overview● Live metrics● Events Timeline Pop-Up Links● Data sources● Default middleware views● Topology● Tests● Bug fixes

Middleware/Hawkular - Live metrics(A. Bonas)

● Collected live on demand from Hawkular, not persisted in miq db.

● No need to enable C&U workers

Middleware/Hawkular - event links (A. Bonas)

● Links to provider and entity in event popups

Middleware/Hawkular - Default views(A. Bonas)

● Allow to configure default views for all middleware entities.

Middleware/Hawkular - Datasources (A. Bonas)

● New entity Datasource - UI and backend were added (not in topology yet)

Middleware/Hawkular - Misc(A. Bonas)

● Topology - backend was rewritten based on generic topology

● Topology - more unit tests were added● Bug fixes - removing not implemented and

irrelevant features from UI

User Interface (D. Clarizio)

● PRs merged (140+)

○ SSUI (10)

○ Bugs (90)

○ Enhancements (27)

○ Refactoring/Technical Debt (18)

User Interface (D. Clarizio)

● New functionality

○ Containers - Added Persistent Volume Claims + UI

○ Containers - Added Seed for policies, policy sets, policy contents and

conditions

○ Containers - Auto-tagging from kubernetes labels (backend only)

○ Containers - Added MiqAction to annotate container images as non

secure at openshift

○ OpenStack - Cloud Volumes Add/Delete/Update/Attach/Detach

○ Ansible Inventories/Configured Systems

○ SSUI Navigation bar restyled to match Operations UI

○ SSUI HTML5 Console support for Service VMs (using new console-

proxy implementation)

○ SSUI Shopping Cart

○ New development tool: tota11y (H. Rupp)

User InterfaceOpenStack Cloud Volumes

User InterfaceAnsible Inventories/Configured Systems



User InterfaceSSUI Updated Navigation Style

User InterfaceSSUI HTML5 Console Support

User InterfaceSSUI Shopping Cart

Demo

User Interface (dev) - tota11y(H. Rupp)

Tool to improve accessibility (a11y)

User Interface (dev) - tota11y(H. Rupp)

Platform (G. Tanzillo)

Enhancements and Bug Fixes

● Replication

● Tenancy

● Expressions

● oVirt Metrics Gem

● Chargeback

● Rest API (A. Bellotti)

Platform - Replication(G. Tanzillo)

Database Schema● Column order is important for pglogical

○ Regional and Global DBs MUST have identical

schemas

○ Migrations must have timestamp later than the last

migration of previous version for correct column order

○ Specs added to validate schema

○ See New Schema Specs for New Replication

http://talk.manageiq.org/t/new-schema-specs-for-new-replication/1404

Platform - Tenancy(G. Tanzillo)

Splitting MiqGroup, Part 2

● Filters moved to to Entitlement model

● Enabler for sharing entitlements across tenants

Platform - Expressions(G. Tanzillo)

MiqExpression refactoring

● Refactoring existing tests

● Adding new tests for areas lacking coverage

● Building SQL with Arel

Platform - oVirt Metrics

ovirt-metrics gem fixed for Rails 5

● oVirt DB requires Postgres 8.4

● Rails 5 requires Postgres 9.1 or higher

● Gem updated with custom adapter to enable running on

Rails 5 and connecting to oVirt DB on Postgres 8.4

Platform - Chargeback(G. Tanzillo)

Chargeback Rate Tiers / Multi-currency

Demo

REST API (A. Bellotti)

● Post Darga versioning updated to v2.3.0-pre

● Added GET role identifiers○ Earlier, GETs results were only RBAC filtered

○ With this change, GET requests are first verified against the user’s role

and return a 403 if unauthorized to do the queries.

● Added support for Shopping Carts○ New /api/service_orders collection

■ with service_requests subcollection via /api/service_orders/[cart|:id]/service_requests

○ GET /api/service_orders○ GET /api/service_orders/cart - current shopping cart○ GET /api/service_orders/:id - wish list, previously ordered carts or the

shopping cart by id


● Creating shopping cart○ This will create the new shopping cart /api/service_orders/cart with the

new service_requests created.○ If the shopping cart already exists, this will add the service_requests to it.

POST /api/service_orders{

“service_requests” : [

{

“service_template_href” : “/api/service_templates/3”,

“attr1” : “value1”,

“attr2” : “value2”,

…

},

{

“service_template_href” : “/api/service_templates/4”,

…

}

]

}


Also, Adding and removing service requests from a shopping cart● POST /api/service_orders/[cart|:id]/service_requests - action add● POST /api/service_orders/[cart|:id]/service_requests - action remove

Deleting shopping carts● POST /api/service_orders/[cart|:id] - action delete● DELETE /api/service_orders/[:cart|:id]

Clearing the Cart● POST /api/service_orders/[cart|:id] - action clear

Ordering the Cart

● POST /api/service_orders/[cart|:id] - action order


● Exposing vms as formal subcollection of services● GET /api/services/:id/vms

Allows for querying additional attributes for the vms resources of a service● GET /api/services/:id?expand=vms&attributes=vms.num_cpu

● Added support for decorators via the decorators= parameter similar to attributes.○ Currently supporting vms subcollection○ GET /api/services/:id?expand=vms&decorators=vms.supports_console?

Automate(G. McCullough)

● Default Retirement state-machine behavior changed to retain record (historical data)○ DeleteFromVMDB state commented out

● New Service Model:○ Account

■ Exposed on vm_or_template model as:● accounts● users● groups

Provisioning(G. McCullough)

● VMware Distributed Switches now referenced from database during provisioning workflow○ Previously required connection to provider when

workflow initialized○ Known issues

■ Extended loading times■ Increased session size due to caching of results■ Possible connection timeouts

Ansible Tower(G. McCullough)

● Automate ○ New wait_for_ip method/state added to state-

machine

● Services○ Added support for generating Service Dialogs from

AnsibleTower JobTemplate○ Support setting AnsibleTower JobTemplate variables

through:■ Dialog Options■ Automate methods

Performance (D. Metzger)

Pull RequestsTotal Merged: 10

Bugs: 3

Refactoring: 2

Enhancements: 5

Performance (D. Metzger)

● Eliminated a Drb related thread leak○ Discovered in the QE Automate Workload test

● Fixed performance capture failure on cloud platforms○ Caused by orphan VMs○ DB repair script provided to customer○ Code updated to prevent the orphan creation

● MiqRequestWorkflow enhancement○ Optional use of RBAC in dialog field validation○ 10 minute service template provision test reduced to 4

minutes

Discussion

Next Sprint Review - June 1

Sprint 40 review

Technology