ManageIQ
Sprint 74 Review - Sprint End November 27, 2017
November 29, 2017
Meeting Start: 10:30am EST
Overview
● Sprint Statistics (Oleg Barenboim)
● Community Update (Carol Chen)
● Classic UI (Just Bug Fixes!)
● Service UI (Just Bug Fixes!)
● Providers (Daniel Berger, Adam Grare, Rich Oliveri)
● Automate (Tina Fitzgerald, Drew Bomhof)
● Platform (Gregg Tanzillo)
● API (Alberto Bellotti)
● Documentation (Chris Budzilowicz)
● Discussion
All Repo Stats - Top 10
Total of 444 merged PRs across 86 ManageIQ Repos
Pull Requests from: 2017-11-14 00:00:00 UTC to: 2017-11-27 00:00:00 UTC
PRs Merged per Sprint across ManageIQ Repositories
Distribution and Types of Merged PRs across ManageIQ
Repositories
Community Update
(Carol Chen)
● Releases
○ Gaprindashvili Beta
http://manageiq.org/blog/2017/11/Announcing-Gaprindashvili-Beta1/
○ Name of H-release
http://manageiq.org/blog/2017/11/announce_h_name/
● Last Week in ManageIQ
○ http://manageiq.org/blog/2017/11/im-all-about-the-bugs/ by Julian Cheal
○ http://manageiq.org/blog/2017/11/bugs-in-fix-out/ by Harpreet Kataria
● Events
○ CFPs open for FOSDEM Devrooms (various deadlines up till Dec 15)
https://fosdem.org/2018/news/2017-10-04-accepted-developer-rooms/
○ FOSSASIA Call for Speakers (deadline Dec 27)
https://2018.fossasia.org/speaker-registration
Providers
(Daniel Berger, Adam Grare, Rich Oliveri)
Merged Provider PRs
Providers - Azure, Amazon, Nuage
Azure
- Resource group updates - STI, case and location issues resolved.
Amazon
- Enhanced list of events (cloud network - VPC)
- Various bug fixes - key pairs, empty Name tags and security groups, etc
- Smartstate updates (VPC/subnets, agent coordinator refresh)
Nuage
- Improved exception handling for raw_connect.
Providers - Middleware, Openstack
Middleware
● Re-add remove datasource operation (regression fix)
● Add missing middleware server icon in Policies UI
● Add Translation for Middleware servers so they appear correctly in Alert
profile listings.
Openstack
● Fix missing quota calculations
● Restore missing quotas in new graph-based collector
● Remove floating_ip_address from the create request if it is blank
● safe_call should catch Fog::Errors::NotFound
● Stop cloning of OpenStack infra templates
Providers - RHV, VMware
RHV
● Add routers, security groups, and floating IPs to network manager
● Collect “maintenance” mode for hosts
● Add a button to the provider page that allows to connect to the RHV admin
portal using the RHV provider credentials (supported for RHV 4.1.8 and
above)
VMware
● Collect Host UUID for cross linking with physical servers
Providers - Lenovo
● Physical server refresh
SmartState Analysis
(Rich Oliveri)
SmartState Analysis - Fixes
● Amazon
○ Fixed failure causing job timeout - mismatched hash
key name.
○ Code cleanup based on review comments.
● Windows guest
○ Fail gracefully when expected registry attributes are
missing.
● VMware
(same root cause: Host#address attribute removed)
○ SSA failure on templates.
○ Handsoap error on snapshot delete.
Automate
(Tina Fitzgerald)
PRs Merged: 21
8 - Enhancements, 6 - Bugs, 5 - Technical Debt. 2 - Refactoring
● Provisioning Dialog Displays Host Maintenance
Automate
(Tina Fitzgerald)
● Automate Method Type Icons
○ Tree View
Automate
(Tina Fitzgerald)
● Automate Method Type Icons
○ List View
Automate
(Drew Bomhof)
● Removed external dependencies from the manageiq-automate role.
○ Rest API requests handled by fetch_url (native to Ansible.)
● Created an example on github.com/syncrou/playbooks/test_playbook.yml that
automagically pulls in the galaxy role when run from Embedded Ansible or if
used from Ansible Tower.
Platform
(Gregg Tanzillo)
PRs Merged: 41
16 - Enh, 21 - Bugs, 4 - Tech Debt, Tests and Refactoring
Enhancements
● Replication
○ Bumped the version of pg-pglogical to 2.1.1
■ Enables removal of a dropped table from the replication set
■ Fixes migration failure on remote region due to dropped table
○ Remove the column reordering tool and the schema structure validations
■ pglogical > 2.0 no longer requires schemas to be identical
Bug Fixes
● Fixed a stack trace issue (500) during API authentication
○ Caused by a race condition where the token invalidated after it is checked but before fields are
retrieved
● Fixed Tenant naming uniqueness check in global region
○ Scope Tenant#name validation to the current region
● Fixed error clicking on VMware vms PoweredOff rss link
● Fixed Expression builder argument error building an expression that includes
a VM’s Cloud Tenant
● Fixed error while generating Chargeback reports for cloud providers with
volumes
● Appliance Console issues - Improved error messaging
○ Fixed appliance console cli dump exception stacks if -k when v2_key exists
○ Improved reset database error when there are existing connections
○ correct error message for create internal database without unpartitioned disk available
Platform
(Gregg Tanzillo)
API
(Alberto Bellotti)
● Performance enhancement for custom (button) actions
● Custom actions are no longer returned on collection searches
● They are only returned on resource gets
○ Single GET /api/:collection/:id
○ Multiple POST /api/:collection - bulk action “query”
● Added support for custom actions on resources (Drew U.)
○ Similar usage to custom actions of services and vms
Master and Gaprindashvili:
○ /api/cloud_tenants
○ /api/cloud_volumes
○ /api/clusters
○ /api/container_nodes
○ /api/data_stores
○ /api/hosts
○ /api/providers
○ /api/templates
API
● Adding support for custom actions on resources (Drew U.)
Master only:
○ /api/availability_zones
○ /api/cloud_subnets
○ /api/groups
○ /api/load_balancers
○ /api/network_routers
○ /api/security_groups
○ /api/tenants
○ /api/users
API
● Added support for custom actions on generic object resources (Jillian T.)
● Master and Gaprindashvili
● Custom actions on /api/generic_objects/:id
● Added support for Container Projects (Jillian T.)
● New primary collection /api/container_projects
○ GET /api/container_projects
○ GET /api/container_projects/:id
○ POST /api/container_projects - bulk action “query”
● Custom actions on resources
API
● Added support for Container Templates (Jillian T.)
● New primary collection /api/container_templates
○ GET /api/container_templates
○ GET /api/container_templates/:id
○ POST /api/container_templates - bulk action “query”
● Custom actions on resources
● Added support for Container Volumes (Jillian T.)
● New primary collection /api/container_volumes
○ GET /api/container_volumes
○ GET /api/container_volumes/:id
○ POST /api/container_volumes - bulk action “query”
● Custom actions on resources
API
● Added support for network Switches (Jillian T.)
● New primary collection /api/switches
○ GET /api/container_switches
○ GET /api/container_switches/:id
○ POST /api/container_switches - bulk action “query”
● Custom actions on resources
● Added support for Orchestration Stacks (Jillian T.)
● Previously only accessible as subcollection off services
● Now also exposed as primary collection /api/orchestration_stacks
○ GET /api/orchestration_stacks
○ GET /api/orchestration_stacks/:id
○ POST /api/orchestration_stacks - bulk action “query”
● Custom actions on resources
API
● Added support for Cloud Object Store Containers
● New primary collection /api/cloud_object_store_containers
○ GET /api/cloud_object_store_containers
○ GET /api/cloud_object_store_containers/:id
○ POST /api/cloud_object_store_containers - bulk action “query”
● Custom actions on resources
● Added support for Container Groups
● New primary collection /api/container_groups
○ GET /api/container_groups
○ GET /api/container_groups/:id
○ POST /api/container_groups - bulk action “query”
● Custom actions on resources
API
● Added support for Container Images
● New primary collection /api/container_images
○ GET /api/container_images
○ GET /api/container_images/:id
● Custom actions on resources
● Added support for Cloud Networks custom actions
● GET /api/cloud_networks/:id
● Custom actions on resources
API
● Added ability to refresh Physical Servers (Maysa M.)
● Supporting refresh action on physical servers
● These are async actions returning action results
● Single resource action:
POST /api/physical_servers/:id
{
“action” : “refresh”
}
● Bulk action:
POST /api/physical_servers
{
“action” : “refresh”,
“resources” : [
{ “href” : “/api/physical_servers/101” },
{ “href” : “/api/physical_servers/102” },
{ “id” : “103” }
]
}
● PRs merged - 11
○ Enhancements - 10
○ Bugs 1
● Highlights
○ #586 Further updated to drag-and-drop service dialog editor instructions.
○ #590 Added TTL field to Ansible playbook catalog item.
○ #578 Integrated content on orchestration stacks into Provisioning VMs guide.
○ #580 Added Embedded Ansible role details to server role list.
○ #579 Conditionalized doc so database config only appears in downstream.
○ #591 4.6 Installation guide.
Documentation
(C. Budzilowicz)
Discussion
Sprint 75 Review - December 13
Meeting Start: 10:30am EST

Sprint 74

  • 1.
    ManageIQ Sprint 74 Review- Sprint End November 27, 2017 November 29, 2017 Meeting Start: 10:30am EST
  • 2.
    Overview ● Sprint Statistics(Oleg Barenboim) ● Community Update (Carol Chen) ● Classic UI (Just Bug Fixes!) ● Service UI (Just Bug Fixes!) ● Providers (Daniel Berger, Adam Grare, Rich Oliveri) ● Automate (Tina Fitzgerald, Drew Bomhof) ● Platform (Gregg Tanzillo) ● API (Alberto Bellotti) ● Documentation (Chris Budzilowicz) ● Discussion
  • 3.
    All Repo Stats- Top 10 Total of 444 merged PRs across 86 ManageIQ Repos Pull Requests from: 2017-11-14 00:00:00 UTC to: 2017-11-27 00:00:00 UTC
  • 4.
    PRs Merged perSprint across ManageIQ Repositories
  • 5.
    Distribution and Typesof Merged PRs across ManageIQ Repositories
  • 6.
    Community Update (Carol Chen) ●Releases ○ Gaprindashvili Beta http://manageiq.org/blog/2017/11/Announcing-Gaprindashvili-Beta1/ ○ Name of H-release http://manageiq.org/blog/2017/11/announce_h_name/ ● Last Week in ManageIQ ○ http://manageiq.org/blog/2017/11/im-all-about-the-bugs/ by Julian Cheal ○ http://manageiq.org/blog/2017/11/bugs-in-fix-out/ by Harpreet Kataria ● Events ○ CFPs open for FOSDEM Devrooms (various deadlines up till Dec 15) https://fosdem.org/2018/news/2017-10-04-accepted-developer-rooms/ ○ FOSSASIA Call for Speakers (deadline Dec 27) https://2018.fossasia.org/speaker-registration
  • 7.
    Providers (Daniel Berger, AdamGrare, Rich Oliveri)
  • 8.
  • 9.
    Providers - Azure,Amazon, Nuage Azure - Resource group updates - STI, case and location issues resolved. Amazon - Enhanced list of events (cloud network - VPC) - Various bug fixes - key pairs, empty Name tags and security groups, etc - Smartstate updates (VPC/subnets, agent coordinator refresh) Nuage - Improved exception handling for raw_connect.
  • 10.
    Providers - Middleware,Openstack Middleware ● Re-add remove datasource operation (regression fix) ● Add missing middleware server icon in Policies UI ● Add Translation for Middleware servers so they appear correctly in Alert profile listings. Openstack ● Fix missing quota calculations ● Restore missing quotas in new graph-based collector ● Remove floating_ip_address from the create request if it is blank ● safe_call should catch Fog::Errors::NotFound ● Stop cloning of OpenStack infra templates
  • 11.
    Providers - RHV,VMware RHV ● Add routers, security groups, and floating IPs to network manager ● Collect “maintenance” mode for hosts ● Add a button to the provider page that allows to connect to the RHV admin portal using the RHV provider credentials (supported for RHV 4.1.8 and above) VMware ● Collect Host UUID for cross linking with physical servers
  • 12.
    Providers - Lenovo ●Physical server refresh
  • 13.
    SmartState Analysis (Rich Oliveri) SmartStateAnalysis - Fixes ● Amazon ○ Fixed failure causing job timeout - mismatched hash key name. ○ Code cleanup based on review comments. ● Windows guest ○ Fail gracefully when expected registry attributes are missing. ● VMware (same root cause: Host#address attribute removed) ○ SSA failure on templates. ○ Handsoap error on snapshot delete.
  • 14.
    Automate (Tina Fitzgerald) PRs Merged:21 8 - Enhancements, 6 - Bugs, 5 - Technical Debt. 2 - Refactoring ● Provisioning Dialog Displays Host Maintenance
  • 15.
    Automate (Tina Fitzgerald) ● AutomateMethod Type Icons ○ Tree View
  • 16.
    Automate (Tina Fitzgerald) ● AutomateMethod Type Icons ○ List View
  • 17.
    Automate (Drew Bomhof) ● Removedexternal dependencies from the manageiq-automate role. ○ Rest API requests handled by fetch_url (native to Ansible.) ● Created an example on github.com/syncrou/playbooks/test_playbook.yml that automagically pulls in the galaxy role when run from Embedded Ansible or if used from Ansible Tower.
  • 18.
    Platform (Gregg Tanzillo) PRs Merged:41 16 - Enh, 21 - Bugs, 4 - Tech Debt, Tests and Refactoring Enhancements ● Replication ○ Bumped the version of pg-pglogical to 2.1.1 ■ Enables removal of a dropped table from the replication set ■ Fixes migration failure on remote region due to dropped table ○ Remove the column reordering tool and the schema structure validations ■ pglogical > 2.0 no longer requires schemas to be identical
  • 19.
    Bug Fixes ● Fixeda stack trace issue (500) during API authentication ○ Caused by a race condition where the token invalidated after it is checked but before fields are retrieved ● Fixed Tenant naming uniqueness check in global region ○ Scope Tenant#name validation to the current region ● Fixed error clicking on VMware vms PoweredOff rss link ● Fixed Expression builder argument error building an expression that includes a VM’s Cloud Tenant ● Fixed error while generating Chargeback reports for cloud providers with volumes ● Appliance Console issues - Improved error messaging ○ Fixed appliance console cli dump exception stacks if -k when v2_key exists ○ Improved reset database error when there are existing connections ○ correct error message for create internal database without unpartitioned disk available Platform (Gregg Tanzillo)
  • 20.
    API (Alberto Bellotti) ● Performanceenhancement for custom (button) actions ● Custom actions are no longer returned on collection searches ● They are only returned on resource gets ○ Single GET /api/:collection/:id ○ Multiple POST /api/:collection - bulk action “query” ● Added support for custom actions on resources (Drew U.) ○ Similar usage to custom actions of services and vms Master and Gaprindashvili: ○ /api/cloud_tenants ○ /api/cloud_volumes ○ /api/clusters ○ /api/container_nodes ○ /api/data_stores ○ /api/hosts ○ /api/providers ○ /api/templates
  • 21.
    API ● Adding supportfor custom actions on resources (Drew U.) Master only: ○ /api/availability_zones ○ /api/cloud_subnets ○ /api/groups ○ /api/load_balancers ○ /api/network_routers ○ /api/security_groups ○ /api/tenants ○ /api/users
  • 22.
    API ● Added supportfor custom actions on generic object resources (Jillian T.) ● Master and Gaprindashvili ● Custom actions on /api/generic_objects/:id ● Added support for Container Projects (Jillian T.) ● New primary collection /api/container_projects ○ GET /api/container_projects ○ GET /api/container_projects/:id ○ POST /api/container_projects - bulk action “query” ● Custom actions on resources
  • 23.
    API ● Added supportfor Container Templates (Jillian T.) ● New primary collection /api/container_templates ○ GET /api/container_templates ○ GET /api/container_templates/:id ○ POST /api/container_templates - bulk action “query” ● Custom actions on resources ● Added support for Container Volumes (Jillian T.) ● New primary collection /api/container_volumes ○ GET /api/container_volumes ○ GET /api/container_volumes/:id ○ POST /api/container_volumes - bulk action “query” ● Custom actions on resources
  • 24.
    API ● Added supportfor network Switches (Jillian T.) ● New primary collection /api/switches ○ GET /api/container_switches ○ GET /api/container_switches/:id ○ POST /api/container_switches - bulk action “query” ● Custom actions on resources ● Added support for Orchestration Stacks (Jillian T.) ● Previously only accessible as subcollection off services ● Now also exposed as primary collection /api/orchestration_stacks ○ GET /api/orchestration_stacks ○ GET /api/orchestration_stacks/:id ○ POST /api/orchestration_stacks - bulk action “query” ● Custom actions on resources
  • 25.
    API ● Added supportfor Cloud Object Store Containers ● New primary collection /api/cloud_object_store_containers ○ GET /api/cloud_object_store_containers ○ GET /api/cloud_object_store_containers/:id ○ POST /api/cloud_object_store_containers - bulk action “query” ● Custom actions on resources ● Added support for Container Groups ● New primary collection /api/container_groups ○ GET /api/container_groups ○ GET /api/container_groups/:id ○ POST /api/container_groups - bulk action “query” ● Custom actions on resources
  • 26.
    API ● Added supportfor Container Images ● New primary collection /api/container_images ○ GET /api/container_images ○ GET /api/container_images/:id ● Custom actions on resources ● Added support for Cloud Networks custom actions ● GET /api/cloud_networks/:id ● Custom actions on resources
  • 27.
    API ● Added abilityto refresh Physical Servers (Maysa M.) ● Supporting refresh action on physical servers ● These are async actions returning action results ● Single resource action: POST /api/physical_servers/:id { “action” : “refresh” } ● Bulk action: POST /api/physical_servers { “action” : “refresh”, “resources” : [ { “href” : “/api/physical_servers/101” }, { “href” : “/api/physical_servers/102” }, { “id” : “103” } ] }
  • 28.
    ● PRs merged- 11 ○ Enhancements - 10 ○ Bugs 1 ● Highlights ○ #586 Further updated to drag-and-drop service dialog editor instructions. ○ #590 Added TTL field to Ansible playbook catalog item. ○ #578 Integrated content on orchestration stacks into Provisioning VMs guide. ○ #580 Added Embedded Ansible role details to server role list. ○ #579 Conditionalized doc so database config only appears in downstream. ○ #591 4.6 Installation guide. Documentation (C. Budzilowicz)
  • 29.
    Discussion Sprint 75 Review- December 13 Meeting Start: 10:30am EST