Global Infrastructure Virtualization                          NorthgateArinso HR-IT SolutionsEric FranckxEnterprise IT Arc...
Agenda                                   Introduction - NorthgateArinso                                             Chalen...
Operating in 35 countries                                                                         Regional Offices        ...
What makes NorthgateArinso unique?    • Named hottest SaaS provider in the industry by ERP Executive    • 2010 SAP Pinnacl...
NGA HR Excellence: Delivered.                                                                                             ...
Convergys HRM acquisition: stronger together This acquisition is key to NorthgateArinso achieving its  global vision for g...
APAC Capabilities7
Europe Capabilities8
North America Capabilities9
Latam Capabilities10
Global Service Delivery Network                                                                  DCB                      ...
Agenda                                        Introduction - NorthgateArinso                                          Chal...
Challenges:CXO                                                                     Improve                                ...
Challenges :Customers & Businesses                                                   Dynamic                              ...
Agenda                                        Introduction - NorthgateArinso                                             C...
Old Standard Server Approach                                                       Traditional x86 Architecture           ...
Previous Application Landscape                      Data Base                                                  Data Base  ...
Actual Virtualization Approach (1/2)                                                       Virtualized (Shared) Architectu...
Actual Virtualization Approach (2/2)  •   Reduce costs by consolidating services onto the fewest number of      physical m...
Virtualization Features•   DRS Business-customer Impact ?    • Align IT resources with business priorities,    • Operation...
Virtualization Additional Business Advantages …  •       Rapid Provisioning & Change Management            •       Each ne...
Virtualization New Challenges …        •       Security                  •      The virtual layer will become a potential ...
VirtualizationSome Figures      •   20 ESX servers in DCA, 20 ESX servers in DCB               • ESX servers used for ERP ...
Agenda                                        Introduction - NorthgateArinso                                             C...
Previous Storage Approach      Customer 1                Customer 2                Customer 3                Customer XXX ...
Actual Storage InfrastructureBelgium (1/2)                 FAS-3040                               FAS-3140                ...
Actual Storage InfrastructureBelgium (2/2)   Data Centre   Tier   Head   Shelves     Disk Size     Type                   ...
Actual Storage InfrastructureBelgium (3/2)      •   First contact in 2006 – Storage Vendor Message                •   VMwa...
Actual Storage Infrastructure Belgium (5/2)                                                            RAID-DP            ...
Storage Features: Disk Failure  RAID-DP  Business-customer Impact ? • Higher Data Protection           •      Provides Do...
Storage Features: Pool of Disk/Space  Aggregate  Business-customer Impact ? • Can be grown by adding more disks, • Can ha...
Storage Features: Flexible Space Allocation  FlexVol  Business-customer Impact ?  • Improve data management capabilities ...
Storage Features: Backup/Restore  Snapshot/SnapRestore  Business-customer Impact ?     • Original data is never re-writte...
Storage Features: Manage Share IOPS  FlexShare  Business-customer Impact ?     • Provides for more effective storage cons...
Storage Features: Space Efficiency  De-duplication                                                                  Dupli...
Storage Features: Backup to Disk  SnapVault Business-customer Impact ?  • Cost-effective, disk-to-disk backup for data ce...
Storage Features:Replication  SnapMirror (sync & a-sync) Business-customer Impact ?  • Cost-effective solution           ...
Storage Features:Replication  SnapMirror (sync & a-sync)   Facility 1                                                    ...
Storage Features:Management Software 4 Years ago ...  • Test all SnapManagers during POC     •   Nice tools if you want a...
Storage Features:Protocol  NFS ???                                            Strengths                                  ...
Storage Features:Security  MultiStore                      Create secure logical partitions              VM    VM       V...
NFS Storage ImplementationRecommended layout (1/3)  swap • When combining with NetApp Snap* technologies conserve   Snaps...
NFS Storage Implementation Recommended layout (2/3)  OS disk                                                             ...
NFS Storage Implementation Recommended layout (3/3): Database                                                             ...
NFS Storage Implementation Review RTO/RPO policies                                                   Hourly Snapshots    ...
NFS Storage ImplementationOracle on VMware                   Keep production running while you serve    Production     Ora...
Agenda                                        Introduction - NorthgateArinso                                             C...
NFS Storage Implementation New challenges ...        • Security                  • Share data of multiple customers on sam...
Storage Features: Instant Image/Copy  FlexClone Business-customer Impact ?  • Enables multiple, instant data set clones w...
Working with passionate people is          an advantage because:        • What would you do for your          passion? A L...
Upcoming SlideShare
Loading in …5
×

ERP implementation (Sap, Peoplesoft,...)on NFS storage by Eric Franckx (It Architect)

1,691 views
1,530 views

Published on

Seminar ERP implementation (Sap, Peoplesoft,...)on NFS storage by Eric Franckx (It Architect) during Infosecurity.be 2011

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,691
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
46
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

ERP implementation (Sap, Peoplesoft,...)on NFS storage by Eric Franckx (It Architect)

  1. 1. Global Infrastructure Virtualization NorthgateArinso HR-IT SolutionsEric FranckxEnterprise IT Architect
  2. 2. Agenda Introduction - NorthgateArinso Chalenges and Pain Points Server Virtualization - VWMARE Storage Virtualization - NETAPP Next Steps ?Copyright NorthgateArinso. All rights reserved.
  3. 3. Operating in 35 countries Regional Offices HR Shared ServiceDelivering in 68 countries Centers/Offices Global reach, local delivery A unique HR-centric business model Scale In HR Outsourcing, our total footprint now • c. 8,000 staff in 35 countries includes 16 global service centers and over 100 comprehensive HR BPO contracts.We • Global HR service delivery network : are now able to deliver HRO services in 25 • 20 HR shared service centers worldwide languages in over 100 countries around the • clients in over 100 countries speaking world. 25 languages • over 100 HR BPO customers In HR Technology, we can provide the widest • over 1,000 ERP-based HR choice in software options available in the implementations globally marketplace. We are innovators in platform- based BPO. • supporting over 1/3 of the UK workforce VMWARE Scope NorthgateArinso HR-IT established the • Unique HR-centric business model: HR In HR Consulting, we‟ve Solutions world‟s leading HR technology consulting Outsourcing, HR Consulting & HR Technology practice, with over 3,000 HR technology • Unique HR process capabilities: from HR specialists. We are focused on providing a administration, over payroll, to talent wide portfolio of HR services to both local management and HR analytics and global customers. Copyright NorthgateArinso. All rights reserved.
  4. 4. What makes NorthgateArinso unique? • Named hottest SaaS provider in the industry by ERP Executive • 2010 SAP Pinnacle Award – BPO Provider of the Year • 2010 BPO Provider of the Year • 2009 Winner Top HR Product of the Year by HR Executive • 2009 HROA Awards for Technology Partnership & Thought leadership • 2008 Named Major Outsourcer of the Year by the IPP • 2008 SAP Pinnacle Award – BPO Provider of the Year • 2006 SAP Pinnacle Award – Global Customer Satisfaction • Ranked as top 3 HRO player by HRO Today • Largest SAP HCM consultancy practice globally with over 3,000 experienced consultants Copyright NorthgateArinso. All rights reserved.Copyright NorthgateArinso. All rights reserved.
  5. 5. NGA HR Excellence: Delivered. 5Copyright NorthgateArinso. All rights reserved. Copyright NorthgateArinso. All rights reserved.
  6. 6. Convergys HRM acquisition: stronger together This acquisition is key to NorthgateArinso achieving its global vision for growth and worldwide service delivery. In joining with Convergys‟ HRM division, we are: • Creating the world‟s number one company providing HR software and services • Strengthening our position and brand in the key US marketplace and around the world • Enabling our staff to provide a world-class service to our customers wherever they are based, so they can provide world- class delivery to their workforce • Creating a deal that is transformational, exciting and historic
  7. 7. APAC Capabilities7
  8. 8. Europe Capabilities8
  9. 9. North America Capabilities9
  10. 10. Latam Capabilities10
  11. 11. Global Service Delivery Network DCB Diegem Belgium DCA Anderlecht Belgium Katowice RDC HRO | 80 FTE DCC Newfoundland RDC Atlanta-Georgia HRO/AMO | 500 FTE US Cincinnati COE HRO/AMO | 100 FTE Budapest RDC Dalian RDC HRO | 150 FTE HRO | 50 FTE Granada GDC AMO/SI/OB | 300 FTE Hyderabad GDC AMO | 100 FTE Manila GDC HRO/AMO/SI Jacksonville RDC 250 FTE Mumbai GDC HRO/AMO | 750 FTE HRO | 200 FTE Kuala Lumpur GDC SI/Testing/OB/IS Kochi GDC 330 FTE HRO | 250 FTE Buenos Aires RDC DCF HRO/AMO | 180 FTE Singapore Sao Paulo RDC HRO | 100 FTELocal Delivery Centers Global & Regional Delivery Centers•Americas: Austin, TX, Tallahassee, FL, Mexico, MX •Americas: Jacksonville, FL, Topsail, CA, Cincinnati, OH, Buenos Aires , AR, Sao•EMEA: Brussels, BE, Paris, FR, Aix-en-Provence, FR, Nieuwegein, NL, Frankfurt, DE, Paulo, BR , Montreal, CAPeterborough, UK, Milan, IT, Durban, SA, Moscow, RU, Helsinki, FI, Stockholm, SE, Zürich, •EMEA: Granada, ES, Budapest, HU, Katowice, PLCH, Tel Aviv, IL, Casablanca, MA •APAC: Dalian, CH, Mumbai, IN, Bangalore, IN, Adelaide, AU•APAC: Bangalore, IN, Adelaide, AU, Wellington, NZ
  12. 12. Agenda Introduction - NorthgateArinso Chalenges and Pain Points Server Virtualization - VWMARE Storage Virtualization - NETAPP Next Steps ?Copyright NorthgateArinso. All rights reserved.
  13. 13. Challenges:CXO Improve Improve system Security performance Increase Simplify by < flexibility x platforms Reduce TCO CXO Grow, new Challenges marketsCopyright NorthgateArinso. All rights reserved.
  14. 14. Challenges :Customers & Businesses Dynamic Cost Facility effective Customers Become Agility & Businesses a Partner Copyright NorthgateArinso. All rights reserved.
  15. 15. Agenda Introduction - NorthgateArinso Chalenges and Pain Points Server Virtualization - VWMARE Storage Virtualization - NETAPP Next Steps ?Copyright NorthgateArinso. All rights reserved.
  16. 16. Old Standard Server Approach Traditional x86 Architecture • Single OS image per machine • Software and hardware tightly coupled • Multiple applications often conflict • Underutilized resourcesCopyright NorthgateArinso. All rights reserved.
  17. 17. Previous Application Landscape Data Base Data Base Data Base Data Base Data Base In traditional application deployments, there can be significant server sprawl primarily due to the need to provision separate systems for: • development (DEV), • What about hundreds of customers • quality assurance/test (QAS) (and systems) ? • Complexity of large implementation ? • production (PRD) environments.Copyright NorthgateArinso. All rights reserved.
  18. 18. Actual Virtualization Approach (1/2) Virtualized (Shared) Architecture • Virtualization  ESX Server • Runs directly on hardware • Advanced Resource Management (cpu, memory, disk, network) • High performance and high throughput • SMP Capability • Clustering across physical servers • Multi-OS supportedCopyright NorthgateArinso. All rights reserved.
  19. 19. Actual Virtualization Approach (2/2) • Reduce costs by consolidating services onto the fewest number of physical machines as Infrastructure needs •Maintenance, Leases •Networking •Floor space, Cooling, Power •Disaster Recovery • Provide failover and high availability • Isolate environment but shared hardware • Make better use of capacity • Remove/reduce the limited flexibility in shared environments • Provide more opportunity for server maintenance during normal working hours • Allow heterogeneous environments (OS) on the same hardwareCopyright NorthgateArinso. All rights reserved.
  20. 20. Virtualization Features• DRS Business-customer Impact ? • Align IT resources with business priorities, • Operational simplicity; dramatically increase system administrator productivity, • Add hardware dynamically to avoid over-provisioning to peak load• HA Business-customer Impact ? • Cost effective high availability for all applications, • No need for dedicated stand-by hardware, • None of the cost and complexity of clustering• VMOTION Business-customer Impact ? • Zero downtime, • Complete transaction integrity, • Continuous service availability,  Hardware maintenance without scheduling
  21. 21. Virtualization Additional Business Advantages … • Rapid Provisioning & Change Management • Each new major Application release requires 20-25% more resources • Move old systems to new hardware easily • Free-up space from old hardware, • Benefit from compute power immediately • Simple maintenance of old application system for compliance • Realize immediate ROI • Decrease data centre costs: hardware, labor, floor space, energy, cooling • Easier to manage  less resource • Agility & Adaptive • Can align/adjust/adapt faster „business/application‟ to the market changes/business requirements.Copyright NorthgateArinso. All rights reserved.
  22. 22. Virtualization New Challenges … • Security • The virtual layer will become a potential target for attack for the virtual services (multiple virtual machine) being hosted. • Network access (dedicated NIC, VLAN, …) • Management • Costs estimation, ROI, … • Additional tools • Storage • To be optimum, a SAN/NAS is “required”. • VMWARE features (Vmotion, HA, DRS…) • Backup/restore/DR • Space efficiencyCopyright NorthgateArinso. All rights reserved.
  23. 23. VirtualizationSome Figures • 20 ESX servers in DCA, 20 ESX servers in DCB • ESX servers used for ERP (customers) • ESX servers used for DMZ • Total Virtual Machines : +/- 450 • ERP DCA = xx • DMZ DCA = xx • ERP DCB = xx • DMZ DCB = xx
  24. 24. Agenda Introduction - NorthgateArinso Chalenges and Pain Points Server Virtualization - VWMARE Storage Virtualization - NETAPP Next Steps ?Copyright NorthgateArinso. All rights reserved.
  25. 25. Previous Storage Approach Customer 1 Customer 2 Customer 3 Customer XXX Po w er Ed g e Po w er Ed g e Po w er Ed g e Po w er Ed g e 2950 2950 2950 2950 Po w er Ed g e Po w er Ed g e Po w er Ed g e Po w er Ed g e 2950 2950 2950 2950 ± 30 SAN Easy design and architecture Very inefficient to manage Very inefficient capacity usage Bad TCO and ROI
  26. 26. Actual Storage InfrastructureBelgium (1/2) FAS-3040 FAS-3140 FIL-DCA-AR-01 SP-DCA-ERP-T1N1 FIL-DCA-AR-02 SP-DCA-ERP-T1N2 FAS-3140 FAS-2050 SP-DCA-ERP-T2N1 FIL-DCA-CL-NOR-01 SP-DCA-ERP-T2N2 FIL-DCA-CL-NOR-02 DC1 FAS-3070 Paepsemlaan BXL FAS-3140 FAS-3020 SP-DCB-ERP-T1N1 FIL-DCB-AR-01 SP-DCB-ERP-T1N2 FIL-DCB-AR-02 LABO Humaniteitslaan BXL FAS-3140 FAS-2050 SP-DCB-ERP-T2N1 FIL-DCB-SC-01 SP-DCB-ERP-T2N2 FIL-DCB-SC-02 DC2 Culliganlaan Diegem
  27. 27. Actual Storage InfrastructureBelgium (2/2) Data Centre Tier Head Shelves Disk Size Type 3 300 FC 1 1 450 FC 1 3 300 FC 2 1 450 FC DCA 4 500 SATA 1 1 1000 SATA 2 1 450 FC 4 500 SATA 2 1 450 FC 3 300 FC 1 1 450 FC 1 3 300 FC 2 1 450 FC DCB 4 500 FC 1 1 1000 SATA 2 1 450 FC 4 500 SATA 2 1 450 FC 37 170 TB usable
  28. 28. Actual Storage InfrastructureBelgium (3/2) • First contact in 2006 – Storage Vendor Message • VMware NFS message • Snapshot • SnapMirror vs MetroCluster • MultiStore • Deduplication • Test system – Seeing is believing • VMware on NFS • MultiStore • Oracle on NFS • Snapshot • SnapManager Oracle, SAP, VI • Backup to disk
  29. 29. Actual Storage Infrastructure Belgium (5/2) RAID-DP Thin Provisioning, FlexVol® Deduplication - Compression Storage Snapshot - SnapRestore Efficiency Thin Replication - SnapMirror® Virtual Cloning - FlexClone® FC - SATACopyright NorthgateArinso. All rights reserved.
  30. 30. Storage Features: Disk Failure  RAID-DP Business-customer Impact ? • Higher Data Protection • Provides Double Disk Failure Protection, • Dramatic improvement in data protection at no additional cost, • Optimized for Performance while providing maximum protection • Reduces RAID group Rebuild Time while reducing RISK limiting exposure to same RAID group second disk failure or non-recoverable media error. • Higher capacity and lower cost. • Compared to competitive offerings requiring RAID1/0 to provide similar double disk failure protection double disk drive costsCopyright NorthgateArinso. All rights reserved.
  31. 31. Storage Features: Pool of Disk/Space  Aggregate Business-customer Impact ? • Can be grown by adding more disks, • Can have multiple per system  performance & granularity, • Separates physical allocation from space visible to users, • Manage the storage pool as a resource independent of the volumes.Copyright NorthgateArinso. All rights reserved.
  32. 32. Storage Features: Flexible Space Allocation  FlexVol Business-customer Impact ? • Improve data management capabilities • Volumes can be sized dynamically • Can grow or shrink no disruptively • Can be as small as a few MBs and as large as TBs (16) • No pre-allocation of blocks to a specific volume • Free space flows among all FlexVols in an aggregate; space reallocation without any overhead File Systems Stored in Dynamic Flexible Volumes • Benefits of Thin Provisioning 200 GB 150 300 GB GB 1TB • Increasing I/O Performance (spindle) 100 GB 200 GB 50 GB Flexible Volumes (2TB Provisioned) RAID Groups Aggregate Physical Storage (1TB Total)Copyright NorthgateArinso. All rights reserved.
  33. 33. Storage Features: Backup/Restore  Snapshot/SnapRestore Business-customer Impact ? • Original data is never re-written (WAFL)  faster snapshot as competition: • Copy pointers only, • No data movement, • No performance impact  align with SLA (response time, …), • Support a high number of snapshot of the same data (volume), • Longer restore history capacity • Faster restore  optimum RTO & RPOCopyright NorthgateArinso. All rights reserved.
  34. 34. Storage Features: Manage Share IOPS  FlexShare Business-customer Impact ? • Provides for more effective storage consolidation, • Critical workloads get fastest response when controller is fully loaded, • Storage administrator can make on-the-fly adjustments, • Business-critical applications receive I/O priority.Copyright NorthgateArinso. All rights reserved.
  35. 35. Storage Features: Space Efficiency  De-duplication Duplicate Data Is Eliminated NetApp® FAS RAID Arrays Traditional Enterprise System Dedup saving between 30% and 75%Copyright NorthgateArinso. All rights reserved.
  36. 36. Storage Features: Backup to Disk  SnapVault Business-customer Impact ? • Cost-effective, disk-to-disk backup for data center and remote offices: • Simplify backup administration, • Accelerate backup and recovery, • Minimize storage costs, • Centralize remote site backup over WAN • Efficient backup solution: • Transfer only block-level incremental changes, • Store only changed data, • Eliminated tape at remote sites • Full file system in original format: • Access backups as full file system or LUN images, • Backup copies are open and accessibleCopyright NorthgateArinso. All rights reserved.
  37. 37. Storage Features:Replication  SnapMirror (sync & a-sync) Business-customer Impact ? • Cost-effective solution • Mirror between FC and ATA systems • Leverages Snapshots – efficient storage and bandwidth utilization • Simplifies deployment and management, • Simple set up and recovery • Single product across all storage systems • Leverages SnapManager®, ensuring replication of application consistent snapshots • Puts DR copy to active business use • Space efficient copies without impacting production system, • Remote read access for centralized backup, data distribution to remote sitesCopyright NorthgateArinso. All rights reserved.
  38. 38. Storage Features:Replication  SnapMirror (sync & a-sync) Facility 1 Facility 2 SnapVault Clustered NetApp SnapMirror Clustered NetApp SnapVault Storage Systems Storage Systems NetApp NearStore NetApp NearStore System SystemCopyright NorthgateArinso. All rights reserved.
  39. 39. Storage Features:Management Software 4 Years ago ... • Test all SnapManagers during POC • Nice tools if you want a graphical interface • Works fine to make a Snapshot • Poor integration with SnapMirror • NO integration with SnapVault • Created custom scripts for Oracle and SAP • Created custom scripts for Vmware based on VIBE script, SnapCreator • Now testing Snapmanagers again
  40. 40. Storage Features:Protocol  NFS ??? Strengths  Delivers best IO scaling for shared datastores  Simplest storage management  Transparent storage virtualization  Inexpensive storage networking  Eliminates storage dead spots  No restriction with vSphere feature set Be Aware:  Not as common outside of NetApp & EMC installs  Our largest customers have adopted NFS for simplicity and scalability  64 Datastore limit – Non-issue due to density of the datastore  NetApp key differentiator in the market
  41. 41. Storage Features:Security  MultiStore Create secure logical partitions VM VM VM VM VM VM VM VM VM FlexVol FlexVol FlexVol FlexVol vFiler vFiler vFiler  Multi-tenant customers vFiler vFiler vFiler  Departments MultiStore  Applications
  42. 42. NFS Storage ImplementationRecommended layout (1/3)  swap • When combining with NetApp Snap* technologies conserve Snapshot space by separating valuable data from transient data Option 1 Option 2 Separate vSwap Separate vSwap & GOS Swap
  43. 43. NFS Storage Implementation Recommended layout (2/3)  OS disk • HA/performance : vswitch / x Nics VMWARE ESX Server • Security: Vfiler, Dedicated VLAN • Protocol: DataStore(s) mounted via NFS APP OS • Space Efficency : set Dedup on APP APP OS • OS = a dedicated disk = VMDK OS APP OS Vlan-Y Vlan-Y VMWARE ESX Server NFSCopyright NorthgateArinso. All rights reserved.
  44. 44. NFS Storage Implementation Recommended layout (3/3): Database • HA/performance : vswitch / x Nics VMWARE ESX Server • Security: Vfiler, Dedicated VLAN • Protocol: DataStore(s) mounted via NFS DB DATA • Space Efficency : set Dedup off ORACLE NFS • Database = a dedicated volume OS Vlan-X APP OS Vlan-X Vlan-Y NFS Vlan-Y VMWARE ESX Server NFSCopyright NorthgateArinso. All rights reserved.
  45. 45. NFS Storage Implementation Review RTO/RPO policies  Hourly Snapshots - Every hour from 06.00h till 22.00h Snapshot - Retention is 18  Daily Snapshot - Retention is 9  Runs with the same schedule SnapVault as regular snapshots.  Retention is 30.  Every hour on PROD SnapMirror  Once a day for DEV/QAS (depends on the customer)  One daily Snapshot (retention 7), Datastores SnapMirror, SnapVault (retention 30)Copyright NorthgateArinso. All rights reserved.
  46. 46. NFS Storage ImplementationOracle on VMware Keep production running while you serve Production Oracle’s request to be eligible for their support FlexClone® Call DB1 DB2 support Export DB FlexClone® Log1 Log2 SUSE Linux Enterprise Export Log SUSE Linux NFS Enterprise Swap1 Swap2 Datastore2 NFS OS1 OS2 Datastore1
  47. 47. Agenda Introduction - NorthgateArinso Chalenges and Pain Points Server Virtualization - VWMARE Storage Virtualization - NETAPP Next Steps ?Copyright NorthgateArinso. All rights reserved.
  48. 48. NFS Storage Implementation New challenges ... • Security • Share data of multiple customers on same box • Audit ? • Limit Access to data ? (Multistore, NFS, Kerberos, VLAN,…) • Data protection • Encryption ? (database level  Oracle , storage level  Decru, …) • Type of data: Online data, offline data ? • Offline backup • Mirror Snapvault (disk backup ) between data centre • Customer acceptance (cultural)Copyright NorthgateArinso. All rights reserved.
  49. 49. Storage Features: Instant Image/Copy  FlexClone Business-customer Impact ? • Enables multiple, instant data set clones with no storage overhead: • Immediate, • No performance implications, • Dramatic improvement for application test and development environments • Large space savings for similar volumes, • Use database clones to test migrations, apply bug fixes, upgrades, and patchesCopyright NorthgateArinso. All rights reserved.
  50. 50. Working with passionate people is an advantage because: • What would you do for your passion? A LOT ... • What is behind the technology? PEOPLE Copyright NorthgateArinso. All rights reserved.Copyright NorthgateArinso. All rights reserved.

×