ManageIQ
Sprint 64 Review - Sprint End July 10, 2017
July 12, 2017
Meeting Start: 10:30am EST
Overview
● Sprint Statistics (Jason Frey)
● Community Update (Carol Chen)
● Architecture (Jason Frey)
● Classic UI (Harpreet Kataria)
● Service UI (Allen Wight)
● Providers (Greg B)
● Automate (Tina Fitzgerald)
● Platform (Gregg Tanzillo)
● API (Alberto Bellotti)
● Documentation (Chris Budzilowicz)
● Discussion
All Repo Stats - Top 10
Top Repositories # Closed
ManageIQ/manageiq 148
ManageIQ/integration_tests 84
ManageIQ/manageiq-ui-classic 79
ManageIQ/manageiq_docs 19
ManageIQ/manageiq-pods 18
ManageIQ/manageiq-gems-pending 17
ManageIQ/manageiq-ui-service 15
ManageIQ/manageiq-content 14
ManageIQ/font-fabulous 12
ManageIQ/manageiq-providers-kubernetes 12
Total of 525 closed PRs across 130 ManageIQ Repos
Pull Requests from: 2017-06-19 00:00:00 UTC to: 2017-07-10 00:00:00 UTC
New repositories this sprint:
ansible-tower-pods
container-embedded-ansible
Distribution and Types of Merged PRs across ManageIQ
Repositories
PRs Merged per Sprint across ManageIQ Repositories
Repository Health Report
July 10, 2017
● Last Week in ManageIQ
○ http://manageiq.org/blog/2017/06/migrating-migrations/ by Joe VLcek
○ http://manageiq.org/blog/2017/07/pictures-are-worth-a-thousand-words/ by Drew Bomhof
○ LWIMIQ will be updated fortnightly in July/August (for the next 4 installments)
● Website
○ Icons for ManageIQ highlights and features have been updated on the main page
● Events
○ Looking into ManageIQ participation at events for 2H 2017
○ Contact Carol (https://gitter.im/cybette) if you have ideas/questions/suggestions
Community Update
(Carol Chen)
Architecture
● Kubernetes
○ Bundler groups
○ Heartbeat via file
● MiqQueue
○ ActiveMQ Artemis as replacement seems very promising
○ Continuing to break down existing callers of put_unless_exists and
put_or_update
● Metrics
○ ElasticSearch determined to have poor long term storage
○ Investigating hawkular-metrics and PostgreSQL with jsonb
Architecture
● Inventory
○ VMware Inventory collection directly from WaitForUpdates through
ActiveMQ Artemis
■ Before: 2.34GB / 4.6 minutes [1.56GB (Broker) + 778MB (Refresh
Worker)]
■ After: 101MB / 2.6 minutes
Classic UI
(Harpreet Kataria)
PRs Merged - 63
● Enhancements - 5, Bugs - 37, Tech Debt - 7, Refactoring - 7
Refactoring:
● Cloud subnets using API
Technical Debt:
● Reports code cleanup
● Cleanup in various other areas such as Pagination, ci_processing module, handling of entity delete
from summary screen.
Enhancements:
● Added "Container Template" type support in Catalog Item editor
● Added "Create Service Dialog from Container Template" support
● Custom button submit all
● Added hosts and vms relationship with physical server to physical Infra topology
● CRUD for security group rules (Angular & API)
Service UI
(Allen Wight)
- Sprint Stats
Service UI
(Allen Wight)
- New Features Highlights:
- SUI allows for searching drop down lists
- Add custom buttons on service page
- Create a snapshot from Service Page and Resource
Page
- Bugs:
- Focus on login and dialog bugs
- Chores:
- Updated dependencies
Providers
(Greg Blomquist)
Merged Provider PRs
Provider PRs Provider PRs
kubernetes 12 ansible_tower 3
ovirt 11 foreman 2
amazon 7 hawkular 2
azure 7 google 1
openshift 6 scvmm 1
openstack 4
vmware 4
Providers - Hawkular
Targeted refresh and event catcher enhancement
● Fetching availability metrics for deployments and eap servers, as well as
server state of eap servers
● Following detection of a change in the above fields, a targeted refresh
updates the relevant entities’ status and availability.
The above enhancement allows updating the status of deployments and servers
frequently without the need in manual refresh.
Providers
● Graph refresh updates
● Performance enhancements to full refresh
● Support Host maintenance modes
Providers
EBS Cloud volume and snapshot events added to event
switchboard
- Trigger a refresh to keep inventory up to date
Fast refresh option
- Optimize the use of OpenStack API
Providers
Handle missing orchestration stacks and missing private IP
addresses
Graph Refresh
Respect end_time when collecting metrics
Providers
New Monitoring Manager
Automate
(Tina Fitzgerald)
PRs Merged: 26
5 - Enhancements, 15 - Bugs, 3 - TechDebt, 3 - Refactoring
● Enhancements
○ Expose ae_state_max_retries to Automate
○ Container Template Provisioning Dialog support for auto generated
required fields
○ ManageIQ Python API Client support for token Authentication
● Bugs
○ V2V Automate method fix for drivers list
○ VM Migrate State Machine Error Handling
○ Quota Calculations for multiple VMs
Platform
(Gregg Tanzillo)
PRs Merged: 43
6 - Enh, 26 - Bugs, 6 - TechDebt, 4 - Refactoring, 1- Test
● Enhancements
○ New report - “Amazon - Active VMs” added to standard set of reports (vestival)
○ Added samba-common-tools to appliance for Ext Auth to AD help
● Bug Fixes
○ Forked workers removing parent server’s PID file
■ Only remove my process' pidfile
○ Ldap authentication failure in global region
■ Check the current region when creating a new user
○ Websocket connection leaks
■ Disable connection reuse for WebSocket connections in Apache
○ Appliance console crash when invalid IP address entered
○ Existing v2_key lost when fetch/create new v2_key fails
API
(Alberto Bellotti)
● Enhancement to return resource id’s as compressed id string instead of
integer (Tim W.)
○ Integer ids were problematic with large region numbers for Javascript.
● Several bug fixes (Jillian T.)
○ Additional virtual attributes were being returned in addition to requested attributes (result_set,
service_templates, features, etc.) BZ 1437201
○ Fix accessing virtual attributes that are arrays of values BZ 1461939
○ Using the correct role identifier for Vm retirement BZ 1464093
● PRs merged (20)
○ Enhancements 14
○ Bug fixes 6
● Highlights
○ #421 Removed content outlining how to manually enable central administration.
○ #414 Added more information about tenancy quota reporting.
○ #410 Added more information about configuring access to VNC and SPICE consoles.
○ #395 Added more information about SSL options for Hawkular providers.
○ #374 Added more information about SSL options for container providers.
Documentation
(C. Budzilowicz)
Discussion
Sprint 65 Review - July 26
Meeting Start: 10:30am EST

Sprint 64

  • 1.
    ManageIQ Sprint 64 Review- Sprint End July 10, 2017 July 12, 2017 Meeting Start: 10:30am EST
  • 2.
    Overview ● Sprint Statistics(Jason Frey) ● Community Update (Carol Chen) ● Architecture (Jason Frey) ● Classic UI (Harpreet Kataria) ● Service UI (Allen Wight) ● Providers (Greg B) ● Automate (Tina Fitzgerald) ● Platform (Gregg Tanzillo) ● API (Alberto Bellotti) ● Documentation (Chris Budzilowicz) ● Discussion
  • 3.
    All Repo Stats- Top 10 Top Repositories # Closed ManageIQ/manageiq 148 ManageIQ/integration_tests 84 ManageIQ/manageiq-ui-classic 79 ManageIQ/manageiq_docs 19 ManageIQ/manageiq-pods 18 ManageIQ/manageiq-gems-pending 17 ManageIQ/manageiq-ui-service 15 ManageIQ/manageiq-content 14 ManageIQ/font-fabulous 12 ManageIQ/manageiq-providers-kubernetes 12 Total of 525 closed PRs across 130 ManageIQ Repos Pull Requests from: 2017-06-19 00:00:00 UTC to: 2017-07-10 00:00:00 UTC New repositories this sprint: ansible-tower-pods container-embedded-ansible
  • 4.
    Distribution and Typesof Merged PRs across ManageIQ Repositories
  • 5.
    PRs Merged perSprint across ManageIQ Repositories
  • 6.
  • 7.
    ● Last Weekin ManageIQ ○ http://manageiq.org/blog/2017/06/migrating-migrations/ by Joe VLcek ○ http://manageiq.org/blog/2017/07/pictures-are-worth-a-thousand-words/ by Drew Bomhof ○ LWIMIQ will be updated fortnightly in July/August (for the next 4 installments) ● Website ○ Icons for ManageIQ highlights and features have been updated on the main page ● Events ○ Looking into ManageIQ participation at events for 2H 2017 ○ Contact Carol (https://gitter.im/cybette) if you have ideas/questions/suggestions Community Update (Carol Chen)
  • 8.
    Architecture ● Kubernetes ○ Bundlergroups ○ Heartbeat via file ● MiqQueue ○ ActiveMQ Artemis as replacement seems very promising ○ Continuing to break down existing callers of put_unless_exists and put_or_update ● Metrics ○ ElasticSearch determined to have poor long term storage ○ Investigating hawkular-metrics and PostgreSQL with jsonb
  • 9.
    Architecture ● Inventory ○ VMwareInventory collection directly from WaitForUpdates through ActiveMQ Artemis ■ Before: 2.34GB / 4.6 minutes [1.56GB (Broker) + 778MB (Refresh Worker)] ■ After: 101MB / 2.6 minutes
  • 10.
    Classic UI (Harpreet Kataria) PRsMerged - 63 ● Enhancements - 5, Bugs - 37, Tech Debt - 7, Refactoring - 7 Refactoring: ● Cloud subnets using API Technical Debt: ● Reports code cleanup ● Cleanup in various other areas such as Pagination, ci_processing module, handling of entity delete from summary screen. Enhancements: ● Added "Container Template" type support in Catalog Item editor ● Added "Create Service Dialog from Container Template" support ● Custom button submit all ● Added hosts and vms relationship with physical server to physical Infra topology ● CRUD for security group rules (Angular & API)
  • 11.
  • 12.
    Service UI (Allen Wight) -New Features Highlights: - SUI allows for searching drop down lists - Add custom buttons on service page - Create a snapshot from Service Page and Resource Page - Bugs: - Focus on login and dialog bugs - Chores: - Updated dependencies
  • 13.
  • 14.
    Merged Provider PRs ProviderPRs Provider PRs kubernetes 12 ansible_tower 3 ovirt 11 foreman 2 amazon 7 hawkular 2 azure 7 google 1 openshift 6 scvmm 1 openstack 4 vmware 4
  • 15.
    Providers - Hawkular Targetedrefresh and event catcher enhancement ● Fetching availability metrics for deployments and eap servers, as well as server state of eap servers ● Following detection of a change in the above fields, a targeted refresh updates the relevant entities’ status and availability. The above enhancement allows updating the status of deployments and servers frequently without the need in manual refresh.
  • 16.
    Providers ● Graph refreshupdates ● Performance enhancements to full refresh ● Support Host maintenance modes
  • 17.
    Providers EBS Cloud volumeand snapshot events added to event switchboard - Trigger a refresh to keep inventory up to date Fast refresh option - Optimize the use of OpenStack API
  • 18.
    Providers Handle missing orchestrationstacks and missing private IP addresses Graph Refresh Respect end_time when collecting metrics
  • 19.
  • 20.
    Automate (Tina Fitzgerald) PRs Merged:26 5 - Enhancements, 15 - Bugs, 3 - TechDebt, 3 - Refactoring ● Enhancements ○ Expose ae_state_max_retries to Automate ○ Container Template Provisioning Dialog support for auto generated required fields ○ ManageIQ Python API Client support for token Authentication ● Bugs ○ V2V Automate method fix for drivers list ○ VM Migrate State Machine Error Handling ○ Quota Calculations for multiple VMs
  • 21.
    Platform (Gregg Tanzillo) PRs Merged:43 6 - Enh, 26 - Bugs, 6 - TechDebt, 4 - Refactoring, 1- Test ● Enhancements ○ New report - “Amazon - Active VMs” added to standard set of reports (vestival) ○ Added samba-common-tools to appliance for Ext Auth to AD help ● Bug Fixes ○ Forked workers removing parent server’s PID file ■ Only remove my process' pidfile ○ Ldap authentication failure in global region ■ Check the current region when creating a new user ○ Websocket connection leaks ■ Disable connection reuse for WebSocket connections in Apache ○ Appliance console crash when invalid IP address entered ○ Existing v2_key lost when fetch/create new v2_key fails
  • 22.
    API (Alberto Bellotti) ● Enhancementto return resource id’s as compressed id string instead of integer (Tim W.) ○ Integer ids were problematic with large region numbers for Javascript. ● Several bug fixes (Jillian T.) ○ Additional virtual attributes were being returned in addition to requested attributes (result_set, service_templates, features, etc.) BZ 1437201 ○ Fix accessing virtual attributes that are arrays of values BZ 1461939 ○ Using the correct role identifier for Vm retirement BZ 1464093
  • 23.
    ● PRs merged(20) ○ Enhancements 14 ○ Bug fixes 6 ● Highlights ○ #421 Removed content outlining how to manually enable central administration. ○ #414 Added more information about tenancy quota reporting. ○ #410 Added more information about configuring access to VNC and SPICE consoles. ○ #395 Added more information about SSL options for Hawkular providers. ○ #374 Added more information about SSL options for container providers. Documentation (C. Budzilowicz)
  • 24.
    Discussion Sprint 65 Review- July 26 Meeting Start: 10:30am EST