Cloud services promising “optimization on demand” have become steadily more numerous and more powerful in recent years. This presentation offers a user-oriented survey, with a focus on the role of the AMPL modeling language in streamlining development and deployment of optimization models using online tools. Starting with the pioneering free NEOS Server, we compare more recent commercial offerings such as Gurobi Instant Cloud and the Satalia SolveEngine; the benefits of these solver services are enhanced through their use with AMPL’s algebraic modeling facilities. We conclude by introducing QuanDec, which turns AMPL models into web-based collaborative decision-making tools.
Apresentação de artigo. ITS (International Telecommunications Symposium) 2014...Guilherme Varela Barbosa
Apresentação de defesa de artigo. (International Telecommunications Symposium, ITS 2014.Coded Cooperation with Single Parity-Check Turbo-Product Codes over Fast Fading Channels. 2014.)
Introduction to Bayesian modelling and inference with Pyro for meetup group. Part of the presentation is a hands on, with some examples available here: https://github.com/ahmadsalim/2019-meetup-pyro-intro
This document outlines the EMPhASIS project which aims to develop an embedded public attention stress identification system. It presents the roadmap and design overview, including extracting time and frequency features from ECG signals using trapezoidal integration and Fourier transforms. These features, like mean RR interval and LF/HF ratio, are then classified to predict stress levels. The core algorithms could also be reused for applications like mortality risk assessment or emotion detection. Overall, the document provides an overview of the EMPhASIS project goals, design approach, and potential applications of their stress identification system.
The document describes the DataBearings platform for semantic data integration. DataBearings uses semantic technologies to integrate heterogeneous data sources on-the-fly without loading data into a warehouse first. This allows for live access to data, integration of IoT data sources, and cost savings by leveraging existing data. DataBearings provides a lightweight solution for dynamic data integration through semantic annotations, reusable components, and a semantic agent programming language to define integration logic and automations.
The document presents a framework for inspecting URLs connected to by third-party Android APK files. It uses a headless browser and CasperJS scripting to crawl APK files and extract over 12,000 URLs. It then applies FARIS, a fast URL filter, to match the URLs against blacklists from AdBlock Plus. Experiments show FARIS can process the URL strings more efficiently than using regular expressions alone. The framework aims to help analyze the large number of third-party APKs for potential malware or adware connections.
Session 1 - The Current Landscape of Big Data BenchmarksDataBench
The panelists discussed various big data and AI benchmarks. Axel Ngonga presented on benchmarking platforms and AI from the perspective of the BDVA TF6 Benchmark group. Wangling Gao discussed BenchCouncil benchmarks including BigDataBench and AIBench. Rekha Singhal talked about MLPerf for AI and ML benchmarking as well as ABench. Todor Ivanov provided a conclusion on the current big data and AI benchmark landscape. The DataBench framework was also introduced for relating benchmarks to the different steps in a generic big data pipeline.
Tech talk by Serena Signorelli (https://www.linkedin.com/in/serenasignorelli/) in the event ''Tensorflow and Sparklyr: Scaling Deep Learning and R to the Big Data ecosystem'', May 15, 2017 at ICTeam Grassobbio (BG). The event was part of the Data Science Milan Meetup (https://www.meetup.com/it-IT/Data-Science-Milan/).
Sparklyr: Big Data enabler for R users - Serena Signorelli, ICTEAMData Science Milan
This document provides an overview of Sparklyr, an R package that allows users to work with big data in Apache Spark from within R. It discusses Sparklyr's key features like using dplyr verbs to manipulate Spark DataFrames and access Spark ML routines. The presentation also compares Sparklyr to the native SparkR package and demonstrates how to analyze NYC taxi data with Sparklyr.
Apresentação de artigo. ITS (International Telecommunications Symposium) 2014...Guilherme Varela Barbosa
Apresentação de defesa de artigo. (International Telecommunications Symposium, ITS 2014.Coded Cooperation with Single Parity-Check Turbo-Product Codes over Fast Fading Channels. 2014.)
Introduction to Bayesian modelling and inference with Pyro for meetup group. Part of the presentation is a hands on, with some examples available here: https://github.com/ahmadsalim/2019-meetup-pyro-intro
This document outlines the EMPhASIS project which aims to develop an embedded public attention stress identification system. It presents the roadmap and design overview, including extracting time and frequency features from ECG signals using trapezoidal integration and Fourier transforms. These features, like mean RR interval and LF/HF ratio, are then classified to predict stress levels. The core algorithms could also be reused for applications like mortality risk assessment or emotion detection. Overall, the document provides an overview of the EMPhASIS project goals, design approach, and potential applications of their stress identification system.
The document describes the DataBearings platform for semantic data integration. DataBearings uses semantic technologies to integrate heterogeneous data sources on-the-fly without loading data into a warehouse first. This allows for live access to data, integration of IoT data sources, and cost savings by leveraging existing data. DataBearings provides a lightweight solution for dynamic data integration through semantic annotations, reusable components, and a semantic agent programming language to define integration logic and automations.
The document presents a framework for inspecting URLs connected to by third-party Android APK files. It uses a headless browser and CasperJS scripting to crawl APK files and extract over 12,000 URLs. It then applies FARIS, a fast URL filter, to match the URLs against blacklists from AdBlock Plus. Experiments show FARIS can process the URL strings more efficiently than using regular expressions alone. The framework aims to help analyze the large number of third-party APKs for potential malware or adware connections.
Session 1 - The Current Landscape of Big Data BenchmarksDataBench
The panelists discussed various big data and AI benchmarks. Axel Ngonga presented on benchmarking platforms and AI from the perspective of the BDVA TF6 Benchmark group. Wangling Gao discussed BenchCouncil benchmarks including BigDataBench and AIBench. Rekha Singhal talked about MLPerf for AI and ML benchmarking as well as ABench. Todor Ivanov provided a conclusion on the current big data and AI benchmark landscape. The DataBench framework was also introduced for relating benchmarks to the different steps in a generic big data pipeline.
Tech talk by Serena Signorelli (https://www.linkedin.com/in/serenasignorelli/) in the event ''Tensorflow and Sparklyr: Scaling Deep Learning and R to the Big Data ecosystem'', May 15, 2017 at ICTeam Grassobbio (BG). The event was part of the Data Science Milan Meetup (https://www.meetup.com/it-IT/Data-Science-Milan/).
Sparklyr: Big Data enabler for R users - Serena Signorelli, ICTEAMData Science Milan
This document provides an overview of Sparklyr, an R package that allows users to work with big data in Apache Spark from within R. It discusses Sparklyr's key features like using dplyr verbs to manipulate Spark DataFrames and access Spark ML routines. The presentation also compares Sparklyr to the native SparkR package and demonstrates how to analyze NYC taxi data with Sparklyr.
apidays Paris 2022 - The New API Challenges, Pierre-Raymond Pouligny, Bolloréapidays
apidays Paris 2022 - APIs the next 10 years: Software, Society, Sovereignty, Sustainability
December 14, 15 & 16, 2022
Digitalization and Microservices, the new API Challenges
Pierre-Raymond Pouligny, Head of Architecture and Public Cloud at Bolloré
------
Check out our conferences at https://www.apidays.global/
Do you want to sponsor or talk at one of our conferences?
https://apidays.typeform.com/to/ILJeAaV8
Learn more on APIscene, the global media made by the community for the community:
https://www.apiscene.io
Explore the API ecosystem with the API Landscape:
https://apilandscape.apiscene.io/
Deep dive into the API industry with our reports:
https://www.apidays.global/industry-reports/
Subscribe to our global newsletter:
https://apidays.typeform.com/to/i1MPEW
Python time series analysis and visualization for self-driving carsAndreas Pawlik
This document discusses using Python and Spark for time series analysis and visualization of data from self-driving cars. It introduces DaSense, a language and framework for analyzing large sets of sensor data from autonomous vehicles on Spark. DaSense allows users to write Python code for time series analysis without knowledge of parallel programming. It also includes features like data extractors, lazy evaluation, optimized data structures, and the ability to integrate custom algorithms. The document concludes with an example analysis pipeline using DaSense to calibrate the automatic distance control system on a vehicle by analyzing histograms of distances to preceding vehicles.
Use Cases of the CPaaS.io project as presented at the first year review meeting in Tokyo on October 5, 2017.
Disclaimer:
This document has been produced in the context of the CPaaS.io project which is jointly funded by the European Commission (grant agreement n° 723076) and NICT from Japan (management number 18302). All information provided in this document is provided "as is" and no guarantee or warranty is given that the information is fit for any particular purpose. The user thereof uses the information at its sole risk and liability. For the avoidance of all doubts, the European Commission and NICT have no liability in respect of this document, which is merely representing the view of the project consortium. This document is subject to change without notice.
Walkalytics - Reachability Analysis for your businessStephan Heuel
Walking is the most natural mode of transportation. It is available everywhere and is usually the first and last part of a journey, whether long or short. We have developed an area-based approach for computing the paths and reachability for pedestrians, calculated to an accuracy of just a few meters.
We use heterogeneous data sources and can even model desire paths which are not explicitly mapped in the base data. In particular, we do not rely on a consistent routing network.
Developing Optimization Applications Quickly and Effectively with Algebraic M...Bob Fourer
Can you negotiate the complexities of the optimization modeling lifecycle, to deliver a working application before the funding runs out or the problem owner loses interest? Algebraic languages streamline the key steps of model formulation, testing, and revision, while offering powerful facilities for incorporating models into larger systems and deploying them to users. This presentation introduces algebraic modeling for optimization by carrying a single illustrative example through multiple contexts, from interactively evolved formula- tions to scripted iterative schemes to embedded applica- tions. We feature the new Python API for AMPL, and the QuanDec system for creating web-based collaborative applications from AMPL models.
1) Dr. Lars Völker presented on communication protocols for Ethernet in vehicles, discussing use cases, requirements, and challenges.
2) A key part of the presentation was an overview of the SOME/IP middleware protocol, which allows applications to communicate over Ethernet and TCP/IP in a way that supports automotive needs like CAN-like communication.
3) Testing complex protocol stacks like SOME/IP presents challenges, requiring support from protocols like the Enhanced Testability Service.
Jose Saldana, Luigi Iannone, Diego R. Lopez, Julian Fernandez-Navajas, Jose Ruiz-Mas, "Enhancing Throughput Efficiency via Multiplexing and Header Compression over LISP Tunnels" . In Proc. Second IEEE Workshop on Telecommunication Standards: From Research to Standards, Collocated with IEEE ICC 2013, Budapest, Hungary. ISBN 9781467357524
This article explores the possibility of using traffic optimization techniques within the context of the LISP (Locator/ Identifier Separation Protocol) framework. These techniques use Tunneling, Multiplexing and header Compression of Traffic Flows (TCMTF) in order to save bandwidth and to reduce the amount of packets per time unit. Taking into account that encapsulation is necessary in LISP, bandwidth can be drastically reduced in flows using small packets, which are typical of many real-time services. The ability of the LISP framework to manage the signaling of TCMTF options is also studied. An analytical expression of the savings, as a function of the different header sizes, is devised and used to calculate the maximum expected savings. Different services and scenarios of interest are identified, and this allows the consideration of tests with real traffic traces, showing the savings as a function of the multiplexing period, and demonstrating that the additional delays can be acceptable for real-time services.
Parametric Estimation for Reliable Project EstimatesFrank Vogelezang
Frank Vogelezang is a manager at Ordina who gives presentations on parametric estimation for reliable IT project estimates. The presentation covers estimating IT projects, translating requirements to a functional size measured in function points, and using proven reference data through parametric analysis to build reliable cost and schedule estimates. Keeping track of actual project performance allows re-estimating and incorporating experience to improve future parametric estimates.
Getting The Most Out Of Your ERP Systemjaysrinivasan
Collaborative ERP (cERP) aims to facilitate information exchange across the extended enterprise using the web. It goes beyond just sharing data by enabling increased partnering between organizations through co-managed processes and shared information. While cERP promises benefits like reduced costs and inventory levels, its implementation requires assessing an organization's readiness, establishing internal collaborative processes, and piloting with partners to develop and refine collaboration approaches. Lessons learned emphasize establishing a clear value proposition, selecting the right partners and technologies, and managing cERP as an ongoing process rather than a single event.
Stephen Brewin has over 40 years of experience as a programmer and analyst working with various hardware and languages. He is currently working as a programmer for HCL maintaining finance systems for Debenhams using RPG400 and RPGIV on IBM AS/400. Previously he held contracting and permanent positions with retailers and other companies where he developed, maintained, and enhanced various business systems.
APIs and Services for Fleet Management - Talks given @ APIDays Berlin and Ba...Toralf Richter
Insights and expereinces into making of APIs for a fleet management SaaS platform. Introduces and describes the functionality of the WEBFLEET platform and how this is made generally available through APIs. Focuses on the aspects of API making and API mangement especially in a B2B environment and the fleet mangement industry.
The document summarizes placement news and hiring activity for December 2009. It provides details of the number of job requirements and hirings by module. A total of 109 job requirements were reported in December 2009. The modules with the most hirings were ABAP with 20 hires, FI with 11 hires, and HR and MM each with 4 hires. The document lists the top companies that hired for each module in December 2009.
The agenda outlines a series of presentations on topics related to open data and transportation, including presentations from Telia, Samtrafiken, SL, and Trafikverket, as well as a discussion on deep learning and its applications in transportation. There will also be a brief networking break and awards ceremony for "Traffic Lab Hero of the Year" in the middle of the event. The event runs from 4:30pm to 6:45pm and covers a wide range of topics at the intersection of open data and transportation.
Slide: Formal Verification of Probabilistic Systems in ASMETARiccardo Melioli
Information Technology (IT) systems are constantly growing in everyday life, particularly in safety-critical scenarios (such as the automotive, avionics, medical, etc.) in which reliability and correctness are the main requirements that must be guaranteed.
The complexity of the information systems is increasing, and recently, in the scenario of modern systems, the Cyber-Physical System (CPS) emerged as systems in which the software component interacts continuously with the physical system in which the software operates. Compared to the dynamics of classical systems, the physical component of a CPS introduces new aspects to consider in the behavior of a system, in particular probabilistic behaviors.
Model-Based Optimization for Effective and Reliable Decision-MakingBob Fourer
Optimization originated as an advanced mathematical technique, but it has become an accessible and widely used decision-making tool. A key factor in the spread of successful optimization applications has been the adoption of a model-based approach: A domain expert or operations analyst focuses on modeling the problem of interest, while the computation of a solution is left to general-purpose, off-the-shelf solvers; powerful yet intuitive modeling software manages the difficulties of translating between the human modeler’s formulation and the solver software’s needs. This talk introduces model-based optimization by contrasting it to a method-based approach that relies on customized implementation of rules and algorithms. Model-based implementations are illustrated using the AMPL modeling language and popular solvers. The presentation concludes by surveying the variety of modeling languages and solvers available for model-based optimization today.
This document summarizes the key new features in Spark 2.0, including a new Spark Session entry point that unifies SQLContext and HiveContext, unified Dataset and DataFrame APIs, enhanced SQL features like subqueries and window functions, built-in CSV support, machine learning pipeline persistence across languages, approximate query functions, whole-stage code generation for performance improvements, and initial support for structured streaming. It provides examples of using several of these new features and discusses Combient's role in helping customers with analytics.
The Summer 2019 Release introduces OpsQ Observed Mode to build confidence in machine learning models for IT event and performance analysis. It also includes automated alert suppression to reduce human time spent on first-response to alerts, continuous learning-based alert escalation using live event data, and new infrastructure monitoring capabilities for cloud native environments.
Watch our on-demand webinar to see all the new enhancements to the platform, including:
OpsQ Observed Mode: OpsQ Observed Mode helps incident management teams assess the accuracy of the OpsRamp machine learning algorithms in a live production environment before they take effect.
Learning-Based Auto-Alert Suppression: OpsQ looks for recurring alert patterns in production environments and suppresses those alerts that occur at a predictable cadence. OpsQ uses seasonality-based and attribute-based auto-alert suppression techniques as a first-response mechanism.
Service and Topology Maps: The Summer 2019 Release introduces new impact visibility and service context features that deliver dynamic relationship data for public cloud services and actionable insights for understanding cross-site interconnections.
Cloud Native Discovery and Monitoring: DevOps and site reliability engineering (SRE) teams can now monitor popular open source applications used in cloud native environments and access relevant performance insights for Mesosphere and Azure Stack in the OpsRamp platform
Learn more at https://www.opsramp.com
Also, follow us on social media channels to learn about product highlights, news, announcements, events, conferences and more:
Twitter - https://www.twitter.com/OpsRamp
LinkedIn - https://www.linkedin.com/company/opsramp
Facebook - https://www.facebook.com/OpsRampHQ/
As optimization methods have been applied more broadly and effectively, a key factor in their success has been the adoption of a model-based approach. A researcher or analyst focuses on modeling the problem of interest, while the computation of a solution is left to general-purpose, off-the-shelf solvers; independent modeling languages and systems manage the difficulties of translating between the human modeler’s ideas and the computer software’s needs. This tutorial introduces model-based optimization with examples from the AMPL modeling language and various popular solvers; the presentation concludes by surveying current software, with special attention to the role of constraint programming.
As optimization (or prescriptive analytics) has grown as a tool for business decision-making, a key factor in its success has been the adoption of model-based optimization. Using this approach, an analyst’s major work is to describe a problem of interest by means of an algebraic model, while the computation of a solution is left to general-purpose, off-the-shelf software. Powerful modeling systems manage the difficulties of translating between the human modeler’s ideas and the computer software’s needs. This tutorial introduces model-based optimization and offers a guide to its effective use.
apidays Paris 2022 - The New API Challenges, Pierre-Raymond Pouligny, Bolloréapidays
apidays Paris 2022 - APIs the next 10 years: Software, Society, Sovereignty, Sustainability
December 14, 15 & 16, 2022
Digitalization and Microservices, the new API Challenges
Pierre-Raymond Pouligny, Head of Architecture and Public Cloud at Bolloré
------
Check out our conferences at https://www.apidays.global/
Do you want to sponsor or talk at one of our conferences?
https://apidays.typeform.com/to/ILJeAaV8
Learn more on APIscene, the global media made by the community for the community:
https://www.apiscene.io
Explore the API ecosystem with the API Landscape:
https://apilandscape.apiscene.io/
Deep dive into the API industry with our reports:
https://www.apidays.global/industry-reports/
Subscribe to our global newsletter:
https://apidays.typeform.com/to/i1MPEW
Python time series analysis and visualization for self-driving carsAndreas Pawlik
This document discusses using Python and Spark for time series analysis and visualization of data from self-driving cars. It introduces DaSense, a language and framework for analyzing large sets of sensor data from autonomous vehicles on Spark. DaSense allows users to write Python code for time series analysis without knowledge of parallel programming. It also includes features like data extractors, lazy evaluation, optimized data structures, and the ability to integrate custom algorithms. The document concludes with an example analysis pipeline using DaSense to calibrate the automatic distance control system on a vehicle by analyzing histograms of distances to preceding vehicles.
Use Cases of the CPaaS.io project as presented at the first year review meeting in Tokyo on October 5, 2017.
Disclaimer:
This document has been produced in the context of the CPaaS.io project which is jointly funded by the European Commission (grant agreement n° 723076) and NICT from Japan (management number 18302). All information provided in this document is provided "as is" and no guarantee or warranty is given that the information is fit for any particular purpose. The user thereof uses the information at its sole risk and liability. For the avoidance of all doubts, the European Commission and NICT have no liability in respect of this document, which is merely representing the view of the project consortium. This document is subject to change without notice.
Walkalytics - Reachability Analysis for your businessStephan Heuel
Walking is the most natural mode of transportation. It is available everywhere and is usually the first and last part of a journey, whether long or short. We have developed an area-based approach for computing the paths and reachability for pedestrians, calculated to an accuracy of just a few meters.
We use heterogeneous data sources and can even model desire paths which are not explicitly mapped in the base data. In particular, we do not rely on a consistent routing network.
Developing Optimization Applications Quickly and Effectively with Algebraic M...Bob Fourer
Can you negotiate the complexities of the optimization modeling lifecycle, to deliver a working application before the funding runs out or the problem owner loses interest? Algebraic languages streamline the key steps of model formulation, testing, and revision, while offering powerful facilities for incorporating models into larger systems and deploying them to users. This presentation introduces algebraic modeling for optimization by carrying a single illustrative example through multiple contexts, from interactively evolved formula- tions to scripted iterative schemes to embedded applica- tions. We feature the new Python API for AMPL, and the QuanDec system for creating web-based collaborative applications from AMPL models.
1) Dr. Lars Völker presented on communication protocols for Ethernet in vehicles, discussing use cases, requirements, and challenges.
2) A key part of the presentation was an overview of the SOME/IP middleware protocol, which allows applications to communicate over Ethernet and TCP/IP in a way that supports automotive needs like CAN-like communication.
3) Testing complex protocol stacks like SOME/IP presents challenges, requiring support from protocols like the Enhanced Testability Service.
Jose Saldana, Luigi Iannone, Diego R. Lopez, Julian Fernandez-Navajas, Jose Ruiz-Mas, "Enhancing Throughput Efficiency via Multiplexing and Header Compression over LISP Tunnels" . In Proc. Second IEEE Workshop on Telecommunication Standards: From Research to Standards, Collocated with IEEE ICC 2013, Budapest, Hungary. ISBN 9781467357524
This article explores the possibility of using traffic optimization techniques within the context of the LISP (Locator/ Identifier Separation Protocol) framework. These techniques use Tunneling, Multiplexing and header Compression of Traffic Flows (TCMTF) in order to save bandwidth and to reduce the amount of packets per time unit. Taking into account that encapsulation is necessary in LISP, bandwidth can be drastically reduced in flows using small packets, which are typical of many real-time services. The ability of the LISP framework to manage the signaling of TCMTF options is also studied. An analytical expression of the savings, as a function of the different header sizes, is devised and used to calculate the maximum expected savings. Different services and scenarios of interest are identified, and this allows the consideration of tests with real traffic traces, showing the savings as a function of the multiplexing period, and demonstrating that the additional delays can be acceptable for real-time services.
Parametric Estimation for Reliable Project EstimatesFrank Vogelezang
Frank Vogelezang is a manager at Ordina who gives presentations on parametric estimation for reliable IT project estimates. The presentation covers estimating IT projects, translating requirements to a functional size measured in function points, and using proven reference data through parametric analysis to build reliable cost and schedule estimates. Keeping track of actual project performance allows re-estimating and incorporating experience to improve future parametric estimates.
Getting The Most Out Of Your ERP Systemjaysrinivasan
Collaborative ERP (cERP) aims to facilitate information exchange across the extended enterprise using the web. It goes beyond just sharing data by enabling increased partnering between organizations through co-managed processes and shared information. While cERP promises benefits like reduced costs and inventory levels, its implementation requires assessing an organization's readiness, establishing internal collaborative processes, and piloting with partners to develop and refine collaboration approaches. Lessons learned emphasize establishing a clear value proposition, selecting the right partners and technologies, and managing cERP as an ongoing process rather than a single event.
Stephen Brewin has over 40 years of experience as a programmer and analyst working with various hardware and languages. He is currently working as a programmer for HCL maintaining finance systems for Debenhams using RPG400 and RPGIV on IBM AS/400. Previously he held contracting and permanent positions with retailers and other companies where he developed, maintained, and enhanced various business systems.
APIs and Services for Fleet Management - Talks given @ APIDays Berlin and Ba...Toralf Richter
Insights and expereinces into making of APIs for a fleet management SaaS platform. Introduces and describes the functionality of the WEBFLEET platform and how this is made generally available through APIs. Focuses on the aspects of API making and API mangement especially in a B2B environment and the fleet mangement industry.
The document summarizes placement news and hiring activity for December 2009. It provides details of the number of job requirements and hirings by module. A total of 109 job requirements were reported in December 2009. The modules with the most hirings were ABAP with 20 hires, FI with 11 hires, and HR and MM each with 4 hires. The document lists the top companies that hired for each module in December 2009.
The agenda outlines a series of presentations on topics related to open data and transportation, including presentations from Telia, Samtrafiken, SL, and Trafikverket, as well as a discussion on deep learning and its applications in transportation. There will also be a brief networking break and awards ceremony for "Traffic Lab Hero of the Year" in the middle of the event. The event runs from 4:30pm to 6:45pm and covers a wide range of topics at the intersection of open data and transportation.
Slide: Formal Verification of Probabilistic Systems in ASMETARiccardo Melioli
Information Technology (IT) systems are constantly growing in everyday life, particularly in safety-critical scenarios (such as the automotive, avionics, medical, etc.) in which reliability and correctness are the main requirements that must be guaranteed.
The complexity of the information systems is increasing, and recently, in the scenario of modern systems, the Cyber-Physical System (CPS) emerged as systems in which the software component interacts continuously with the physical system in which the software operates. Compared to the dynamics of classical systems, the physical component of a CPS introduces new aspects to consider in the behavior of a system, in particular probabilistic behaviors.
Model-Based Optimization for Effective and Reliable Decision-MakingBob Fourer
Optimization originated as an advanced mathematical technique, but it has become an accessible and widely used decision-making tool. A key factor in the spread of successful optimization applications has been the adoption of a model-based approach: A domain expert or operations analyst focuses on modeling the problem of interest, while the computation of a solution is left to general-purpose, off-the-shelf solvers; powerful yet intuitive modeling software manages the difficulties of translating between the human modeler’s formulation and the solver software’s needs. This talk introduces model-based optimization by contrasting it to a method-based approach that relies on customized implementation of rules and algorithms. Model-based implementations are illustrated using the AMPL modeling language and popular solvers. The presentation concludes by surveying the variety of modeling languages and solvers available for model-based optimization today.
This document summarizes the key new features in Spark 2.0, including a new Spark Session entry point that unifies SQLContext and HiveContext, unified Dataset and DataFrame APIs, enhanced SQL features like subqueries and window functions, built-in CSV support, machine learning pipeline persistence across languages, approximate query functions, whole-stage code generation for performance improvements, and initial support for structured streaming. It provides examples of using several of these new features and discusses Combient's role in helping customers with analytics.
The Summer 2019 Release introduces OpsQ Observed Mode to build confidence in machine learning models for IT event and performance analysis. It also includes automated alert suppression to reduce human time spent on first-response to alerts, continuous learning-based alert escalation using live event data, and new infrastructure monitoring capabilities for cloud native environments.
Watch our on-demand webinar to see all the new enhancements to the platform, including:
OpsQ Observed Mode: OpsQ Observed Mode helps incident management teams assess the accuracy of the OpsRamp machine learning algorithms in a live production environment before they take effect.
Learning-Based Auto-Alert Suppression: OpsQ looks for recurring alert patterns in production environments and suppresses those alerts that occur at a predictable cadence. OpsQ uses seasonality-based and attribute-based auto-alert suppression techniques as a first-response mechanism.
Service and Topology Maps: The Summer 2019 Release introduces new impact visibility and service context features that deliver dynamic relationship data for public cloud services and actionable insights for understanding cross-site interconnections.
Cloud Native Discovery and Monitoring: DevOps and site reliability engineering (SRE) teams can now monitor popular open source applications used in cloud native environments and access relevant performance insights for Mesosphere and Azure Stack in the OpsRamp platform
Learn more at https://www.opsramp.com
Also, follow us on social media channels to learn about product highlights, news, announcements, events, conferences and more:
Twitter - https://www.twitter.com/OpsRamp
LinkedIn - https://www.linkedin.com/company/opsramp
Facebook - https://www.facebook.com/OpsRampHQ/
As optimization methods have been applied more broadly and effectively, a key factor in their success has been the adoption of a model-based approach. A researcher or analyst focuses on modeling the problem of interest, while the computation of a solution is left to general-purpose, off-the-shelf solvers; independent modeling languages and systems manage the difficulties of translating between the human modeler’s ideas and the computer software’s needs. This tutorial introduces model-based optimization with examples from the AMPL modeling language and various popular solvers; the presentation concludes by surveying current software, with special attention to the role of constraint programming.
As optimization (or prescriptive analytics) has grown as a tool for business decision-making, a key factor in its success has been the adoption of model-based optimization. Using this approach, an analyst’s major work is to describe a problem of interest by means of an algebraic model, while the computation of a solution is left to general-purpose, off-the-shelf software. Powerful modeling systems manage the difficulties of translating between the human modeler’s ideas and the computer software’s needs. This tutorial introduces model-based optimization and offers a guide to its effective use.
AMPL Workshop, part 1: Model-Based Optimization, Plain and SimpleBob Fourer
Optimization is the most widely adopted technology of Prescriptive Analytics, but also the most challenging to implement. In this two-part workshop, we show how AMPL gets you going without elaborate training, extra programmers, or premature commitments. We start by introducing model-based optimization, the key approach to streamlining the optimization modeling cycle and building successful applications today. Then we demonstrate how AMPL’s design of a language and system for model-based optimization is able to offer exceptional power of expression while maintaining ease of use. The remainder of the presentation takes a single example through successive stages of the optimization modeling life cycle: prototyping, integration, and deployment.
AMPL Workshop, part 2: From Formulation to DeploymentBob Fourer
Optimization is the most widely adopted technology of Prescriptive Analytics, but also the most challenging to implement. In this two-part workshop, we show how AMPL gets you going without elaborate training, extra programmers, or premature commitments. We start by introducing model-based optimization, the key approach to streamlining the optimization
modeling cycle and building successful applications today. Then we demonstrate how AMPL’s design of a language and system for model-based optimization is able to offer exceptional power of expression while maintaining ease of use. The remainder of the presentation takes a single example through successive stages of the optimization modeling life cycle: prototyping, integration, and deployment.
Identifying Good Near-Optimal Formulations for Hard Mixed-Integer ProgramsBob Fourer
When an exact mixed-integer programming formulation resists attempts at solution, sometimes much better results can be achieved by “cheating” a bit on the formulation. Typically, a judicious choice of reformulation, restriction, or decomposition serves to make the problem easier, in a way not guaranteed to preserve the solution's optimality but highly unlikely to make much of a difference given the model and data of interest. This tutorial illustrates such an approach through a series of case studies. All rely on trial and error, a flexible modeling language, and a good general-purpose solver, and each is seen to be founded on one or two simple ideas that have the potential to be more broadly applied.
The Ascendance of the Dual Simplex Method: A Geometric ViewBob Fourer
First described in the 1950s, the dual simplex evolved in the 1990s to become the method most often used in solving linear programs. Factors in the ascendance of the dual simplex method include Don Goldfarb’s proposal for a steepest-edge variant, and an improved understanding of the bounded-variable extension. The ways that these come together to produce a highly effective algorithm are still not widely appreciated, however. This talk employs a geometric approach to the dual simplex method to provide a unified and straightforward description of the factors that work in its favor.
The Evolution of Computationally Practical Linear ProgrammingBob Fourer
Every student of Operations Research learns that linear programs can be solved efficiently. The fascinating story of how they came to be solved efficiently is little known, however.
---
We begin with an account of how a practicable primal simplex method for linear programming was first successfully implemented on primitive computers, by Dantzig, Orchard-Hays and others at the RAND Corporation in the early 1950s. Combining mathematics and engineering, success emerged from a series of innovative reorganizations of the computational steps. One of the key ideas arose unexpectedly as the by-product of an ill-advised plan for avoiding degenerate cycling.
---
At around the same time, early experts in linear programming developed a compact “tableau” scheme for carrying out the computations as a series of “pivots” on a matrix. We consider how the tableau form, impractical for computer implementations, was adopted by almost all textbooks, while the computationally practical form of the simplex method remained obscure.
---
The remainder of the presentation considers how computational practice in linear programming has continued to evolve to the present day. In fact the primal simplex method has become rarely used. We consider the new interior-point methods, which can outperform that simplex method particularly on very large problems; they also went through a period of innovations and false steps before being made practical. Also we consider how the dual simplex method, long considered only a curiosity, has become the preferred method of linear programming solvers today.
Optimization Software and Systems for Operations Research: Best Practices and...Bob Fourer
For a great variety of large-scale optimization problems arising in Operations Research applications, it has become practical to rely on “off-the-shelf” software, without any special programming of algorithms. As a result the use of optimization within business systems has grown dramatically in the past decade.
--
One key factor in this success has been the adoption of model-based optimization. Using this approach, an optimization problem is conceived as a particular minimization or maximization of some function of decision variables, subject to varied equations, inequalities, and other constraints on the variables. A range of computer modeling languages have evolved to allow these optimization models to be described in a concise and readable way, separately from the data that determines the size and shape of the resulting problem that may have thousands (or even millions) of variables and constraints.
--
After an optimization problem is instantiated from the model and data, it is automatically put into a standard mathematical form and solved by sophisticated general-purpose algorithmic software packages. Numerous heuristic routines embedded within these packages enable them to adapt to many problem structures without any special effort from the model builder.
--
The evolution and current state of both modeling and solving software for optimization will be presented in the main part of this talk. The presentation will then conclude with a consideration of current trends and likely future directions.
Natural Language Processing (NLP), RAG and its applications .pptxfkyes25
1. In the realm of Natural Language Processing (NLP), knowledge-intensive tasks such as question answering, fact verification, and open-domain dialogue generation require the integration of vast and up-to-date information. Traditional neural models, though powerful, struggle with encoding all necessary knowledge within their parameters, leading to limitations in generalization and scalability. The paper "Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks" introduces RAG (Retrieval-Augmented Generation), a novel framework that synergizes retrieval mechanisms with generative models, enhancing performance by dynamically incorporating external knowledge during inference.
State of Artificial intelligence Report 2023kuntobimo2016
Artificial intelligence (AI) is a multidisciplinary field of science and engineering whose goal is to create intelligent machines.
We believe that AI will be a force multiplier on technological progress in our increasingly digital, data-driven world. This is because everything around us today, ranging from culture to consumer products, is a product of intelligence.
The State of AI Report is now in its sixth year. Consider this report as a compilation of the most interesting things we’ve seen with a goal of triggering an informed conversation about the state of AI and its implication for the future.
We consider the following key dimensions in our report:
Research: Technology breakthroughs and their capabilities.
Industry: Areas of commercial application for AI and its business impact.
Politics: Regulation of AI, its economic implications and the evolving geopolitics of AI.
Safety: Identifying and mitigating catastrophic risks that highly-capable future AI systems could pose to us.
Predictions: What we believe will happen in the next 12 months and a 2022 performance review to keep us honest.
Predictably Improve Your B2B Tech Company's Performance by Leveraging DataKiwi Creative
Harness the power of AI-backed reports, benchmarking and data analysis to predict trends and detect anomalies in your marketing efforts.
Peter Caputa, CEO at Databox, reveals how you can discover the strategies and tools to increase your growth rate (and margins!).
From metrics to track to data habits to pick up, enhance your reporting for powerful insights to improve your B2B tech company's marketing.
- - -
This is the webinar recording from the June 2024 HubSpot User Group (HUG) for B2B Technology USA.
Watch the video recording at https://youtu.be/5vjwGfPN9lw
Sign up for future HUG events at https://events.hubspot.com/b2b-technology-usa/
Analysis insight about a Flyball dog competition team's performanceroli9797
Insight of my analysis about a Flyball dog competition team's last year performance. Find more: https://github.com/rolandnagy-ds/flyball_race_analysis/tree/main
The Ipsos - AI - Monitor 2024 Report.pdfSocial Samosa
According to Ipsos AI Monitor's 2024 report, 65% Indians said that products and services using AI have profoundly changed their daily life in the past 3-5 years.
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...sameer shah
"Join us for STATATHON, a dynamic 2-day event dedicated to exploring statistical knowledge and its real-world applications. From theory to practice, participants engage in intensive learning sessions, workshops, and challenges, fostering a deeper understanding of statistical methodologies and their significance in various fields."
The Building Blocks of QuestDB, a Time Series Databasejavier ramirez
Talk Delivered at Valencia Codes Meetup 2024-06.
Traditionally, databases have treated timestamps just as another data type. However, when performing real-time analytics, timestamps should be first class citizens and we need rich time semantics to get the most out of our data. We also need to deal with ever growing datasets while keeping performant, which is as fun as it sounds.
It is no wonder time-series databases are now more popular than ever before. Join me in this session to learn about the internal architecture and building blocks of QuestDB, an open source time-series database designed for speed. We will also review a history of some of the changes we have gone over the past two years to deal with late and unordered data, non-blocking writes, read-replicas, or faster batch ingestion.
1. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Robert Fourer, Filipe Brandão, Martin Laskowski
AMPL Optimization Inc.
{4er,fdabrandao,martin}@ampl.com
INFORMS Conference on Business Analytics and Operations Research
Baltimore, April 15-17, 2018
Track 10 — Technology Tutorials — Monday, 3:40-4:30 pm
AMPL in the Cloud
Using Online Services to Develop and Deploy
Optimization Applications through Algebraic Modeling
1
2. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
AMPL in the Cloud
Using Online Services to Develop and Deploy
Optimization Applications through Algebraic Modeling
Cloud services promising “optimization on demand” have become
steadily more numerous and more powerful in recent years. This
presentation offers a user-oriented survey, with a focus on the role of the
AMPL modeling language in streamlining development and deployment
of optimization models using online tools. Starting with the pioneering
free NEOS Server, we compare more recent commercial offerings such as
Gurobi Instant Cloud and the Satalia SolveEngine; the benefits of these
solver services are enhanced through their use with AMPL’s algebraic
modeling facilities. We conclude by introducing QuanDec, which turns
AMPL models into web-based collaborative decision-making tools.
2
3. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Outline
AMPL Introduction
Concept of a modeling language
Example in the AMPL language
AMPL in the cloud
Optimization on demand
NEOS Server
Satalia SolveEngine
IBM Decision Optimization on Cloud
Optimization to order
Gurobi Instant Cloud
Collaborative optimization
QuanDec
4
4. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
The Optimization Modeling Cycle
Steps
Communicate with problem owner
Build model
Prepare data
Generate optimization problem
Submit problem to solver
Gurobi, Knitro, CPLEX, Xpress, CONOPT, MINOS, . . .
Report & analyze results
Repeat until you get it right!
Goals for optimization software
Do this quickly and reliably
Get results before client loses interest
Deploy for application
5
5. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Optimization Modeling Languages
Two forms of an optimization problem
Modeler’s form
Mathematical description, easy for people to work with
Solver’s form
Explicit data structure, easy for solvers to compute with
Idea of a modeling language
A computer-readable modeler’s form
You write optimization problems in a modeling language
Computers translate to algorithm’s form for solution
Advantages of a modeling language
Faster modeling cycles
More reliable modeling
More maintainable applications
6
6. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Algebraic Modeling Languages
Formulation concept
Define data in terms of sets & parameters
Analogous to database keys & records
Define decision variables
Minimize or maximize a function of decision variables
Subject to equations or inequalities
that constrain the values of the variables
Advantages
Familiar
Powerful
Proven
7
7. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Features
Algebraic modeling language
Built specially for optimization
Designed to support many solvers
Design goals
Powerful, general expressions
Natural, easy-to-learn modeling principles
Efficient processing that scales well with problem size
Many ways to use . . .
9
8. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Many Ways to Use AMPL
Command language
Browse results & debug model interactively
Make changes and re-run
Scripting language
Bring the programmer to the modeling language
Programming interface (API)
Bring the modeling language to the programmer
Deployment tool
Turn models into collaboration environments
10
9. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Multicommodity transportation . . .
Products available at factories
Products needed at stores
Plan shipments at lowest cost
11
Example (1st cycle)
10. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Given
𝑂 Set of origins (factories)
𝐷 Set of destinations (stores)
𝑃 Set of products
and
𝑎 Amount available, for each 𝑖 ∈ 𝑂 and 𝑝 ∈ 𝑃
𝑏 Amount required, for each 𝑗 ∈ 𝐷 and 𝑝 ∈ 𝑃
𝑙𝑖𝑗 Limit on total shipments, for each 𝑖 ∈ 𝑂 and 𝑗 ∈ 𝐷
𝑐𝑖𝑗𝑝 Shipping cost per unit, for each 𝑖 ∈ 𝑂, 𝑗 ∈ 𝐷, 𝑝 ∈ 𝑃
12
Mathematical Formulation
Multicommodity Transportation
11. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Determine
𝑋𝑖𝑗𝑝 Amount of each product 𝑝 ∈ 𝑃
to be shipped from origin 𝑖 ∈ 𝑂 to destination 𝑗 ∈ 𝐷
to minimize
∑ ∑ ∑ 𝑐∈∈ 𝑋∈
Total shipping cost
13
Mathematical Formulation
Multicommodity Transportation
12. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Subject to
∑ 𝑋∈ 𝑎 for all 𝑖 ∈ 𝑂, 𝑝 ∈ 𝑃
Total shipments of product 𝑝 out of origin 𝑖
must not exceed availability
∑ 𝑋∈ 𝑏 for all 𝑗 ∈ 𝐷, 𝑝 ∈ 𝑃
Total shipments of product 𝑝 into destination 𝑗
must satisfy requirements
∑ 𝑋∈ 𝑙 for all 𝑖 ∈ 𝑂, 𝑗 ∈ 𝐷
Total shipments from origin 𝑖 to destination 𝑗
must not exceed the limit
14
Mathematical Formulation
Multicommodity Transportation
13. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
15
AMPL Formulation
Symbolic data
set ORIG; # origins
set DEST; # destinations
set PROD; # products
param supply {ORIG,PROD} >= 0; # availabilities at origins
param demand {DEST,PROD} >= 0; # requirements at destinations
param limit {ORIG,DEST} >= 0; # capacities of links
param cost {ORIG,DEST,PROD} >= 0; # shipment cost
Multicommodity Transportation
14. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
16
AMPL Formulation
Symbolic model: variables and objective
var Trans {ORIG,DEST,PROD} >= 0; # actual units to be shipped
minimize Total_Cost:
sum {i in ORIG, j in DEST, p in PROD} cost[i,j,p] * Trans[i,j,p];
Multicommodity Transportation
∑ ∑ ∑ 𝑐∈∈ 𝑋∈
15. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
17
AMPL Formulation
Symbolic model: constraint
subject to Supply {i in ORIG, p in PROD}:
sum {j in DEST} Trans[i,j,p] <= supply[i,p];
Multicommodity Transportation
∑ 𝑋∈ 𝑎 , for all 𝑖 ∈ 𝑂, 𝑝 ∈ 𝑃
16. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
18
AMPL Formulation
Symbolic model: constraints
subject to Supply {i in ORIG, p in PROD}:
sum {j in DEST} Trans[i,j,p] <= supply[i,p];
subject to Demand {j in DEST, p in PROD}:
sum {i in ORIG} Trans[i,j,p] = demand[j,p];
subject to Multi {i in ORIG, j in DEST}:
sum {p in PROD} Trans[i,j,p] <= limit[i,j];
Multicommodity Transportation
17. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
19
AMPL Formulation
Explicit data independent of symbolic model
set ORIG := GARY CLEV PITT ;
set DEST := FRA DET LAN WIN STL FRE LAF ;
set PROD := bands coils plate ;
param supply (tr): GARY CLEV PITT :=
bands 400 700 800
coils 800 1600 1800
plate 200 300 300 ;
param demand (tr):
FRA DET LAN WIN STL FRE LAF :=
bands 300 300 100 75 650 225 250
coils 500 750 400 250 950 850 500
plate 100 100 0 50 200 100 250 ;
param limit default 625 ;
Multicommodity Transportation
18. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
20
AMPL Formulation
Explicit data (continued)
param cost :=
[*,*,bands]: FRA DET LAN WIN STL FRE LAF :=
GARY 30 10 8 10 11 71 6
CLEV 22 7 10 7 21 82 13
PITT 19 11 12 10 25 83 15
[*,*,coils]: FRA DET LAN WIN STL FRE LAF :=
GARY 39 14 11 14 16 82 8
CLEV 27 9 12 9 26 95 17
PITT 24 14 17 13 28 99 20
[*,*,plate]: FRA DET LAN WIN STL FRE LAF :=
GARY 41 15 12 16 17 86 8
CLEV 29 9 13 9 28 99 18
PITT 26 14 17 13 31 104 20 ;
Multicommodity Transportation
19. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
21
AMPL Solution
Model + data = problem instance to be solved
ampl: model multi.mod;
ampl: data multi.dat;
ampl: option solver minos;
ampl: solve;
MINOS 5.51: optimal solution found.
53 iterations, objective 199500
ampl: display Trans;
Trans [CLEV,*,*] (tr)
: DET FRA FRE LAF LAN STL WIN :=
bands 0 225 0 150 0 250 75
coils 525 0 225 75 400 300 75
plate 100 50 100 0 0 0 50
...
Multicommodity Transportation
20. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
22
AMPL Solution
Solver choice independent of model and data
ampl: model multi.mod;
ampl: data multi.dat;
ampl: option solver snopt;
ampl: solve;
SNOPT 7.5-1.2 : Optimal solution found.
60 iterations, objective 199500
ampl: display Trans;
Trans [CLEV,*,*] (tr)
: DET FRA FRE LAF LAN STL WIN :=
bands 150 225 0 0 0 250 75
coils 375 0 225 225 400 300 75
plate 100 50 100 0 0 0 50
...
Multicommodity Transportation
21. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Multicommodity transportation . . .
Products available at factories
Products needed at stores
Plan shipments at lowest cost
. . . revised in light of practical considerations
Using an origin-destination pair incurs some fixed cost
Shipments cannot be too small
Factories cannot serve too many stores
23
Example (4th cycle)
22. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Given
𝑂 Set of origins (factories)
𝐷 Set of destinations (stores)
𝑃 Set of products
and
𝑎 Amount available, for each 𝑖 ∈ 𝑂 and 𝑝 ∈ 𝑃
𝑏 Amount required, for each 𝑗 ∈ 𝐷 and 𝑝 ∈ 𝑃
𝑙𝑖𝑗 Limit on total shipments, for each 𝑖 ∈ 𝑂 and 𝑗 ∈ 𝐷
𝑐𝑖𝑗𝑝 Shipping cost per unit, for each 𝑖 ∈ 𝑂, 𝑗 ∈ 𝐷, 𝑝 ∈ 𝑃
𝑑𝑖𝑗 Fixed cost for shipping any amount from 𝑖 ∈ 𝑂 to 𝑗 ∈ 𝐷
𝑠 Minimum total size of any shipment
𝑛 Maximum number of destinations served by any origin
24
Mathematical Formulation
Multicommodity Transportation
23. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Determine
𝑋𝑖𝑗𝑝 Amount of each 𝑝 ∈ 𝑃 to be shipped from 𝑖 ∈ 𝑂 to 𝑗 ∈ 𝐷
𝑌𝑖𝑗 1 if any product is shipped from 𝑖 ∈ 𝑂 to 𝑗 ∈ 𝐷
0 otherwise
to minimize
∑ ∑ ∑ 𝑐∈∈ 𝑋∈ ∑ ∑ 𝑑∈ 𝑌∈
Total variable cost plus total fixed cost
25
Mathematical Formulation
Multicommodity Transportation
24. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Subject to
∑ 𝑋∈ 𝑎 for all 𝑖 ∈ 𝑂, 𝑝 ∈ 𝑃
Total shipments of product 𝑝 out of origin 𝑖
must not exceed availability
∑ 𝑋∈ 𝑏 for all 𝑗 ∈ 𝐷, 𝑝 ∈ 𝑃
Total shipments of product 𝑝 into destination 𝑗
must satisfy requirements
∑ 𝑋∈ 𝑙 𝑌 for all 𝑖 ∈ 𝑂, 𝑗 ∈ 𝐷
When there are shipments from origin 𝑖 to destination 𝑗,
the total may not exceed the limit, and 𝑌 must be 1
26
Mathematical Formulation
Multicommodity Transportation
25. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Subject to
∑ 𝑋∈ 𝑠𝑌 for all 𝑖 ∈ 𝑂, 𝑗 ∈ 𝐷
When there are shipments from origin 𝑖 to destination 𝑗,
the total amount of shipments must be at least 𝑠
∑ 𝑌∈ 𝑛 for all 𝑖 ∈ 𝑂
Number of destinations served by origin 𝑖
must be as most 𝑛
27
Mathematical Formulation
Multicommodity Transportation
26. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
28
AMPL Formulation
Symbolic data
set ORIG; # origins
set DEST; # destinations
set PROD; # products
param supply {ORIG,PROD} >= 0; # availabilities at origins
param demand {DEST,PROD} >= 0; # requirements at destinations
param limit {ORIG,DEST} >= 0; # capacities of links
param vcost {ORIG,DEST,PROD} >= 0; # variable shipment cost
param fcost {ORIG,DEST} > 0; # fixed usage cost
param minload >= 0; # minimum shipment size
param maxserve integer > 0; # maximum destinations served
Multicommodity Transportation
27. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
29
AMPL Formulation
Symbolic model: variables and objective
var Trans {ORIG,DEST,PROD} >= 0; # actual units to be shipped
var Use {ORIG, DEST} binary; # 1 if link used, 0 otherwise
minimize Total_Cost:
sum {i in ORIG, j in DEST, p in PROD} vcost[i,j,p] * Trans[i,j,p]
+ sum {i in ORIG, j in DEST} fcost[i,j] * Use[i,j];
Multicommodity Transportation
∑ ∑ ∑ 𝑐∈∈ 𝑋∈ ∑ ∑ 𝑑∈ 𝑌∈
28. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
30
AMPL Formulation
Symbolic model: constraints
subject to Supply {i in ORIG, p in PROD}:
sum {j in DEST} Trans[i,j,p] <= supply[i,p];
subject to Demand {j in DEST, p in PROD}:
sum {i in ORIG} Trans[i,j,p] = demand[j,p];
subject to Multi {i in ORIG, j in DEST}:
sum {p in PROD} Trans[i,j,p] <= limit[i,j] * Use[i,j];
subject to Min_Ship {i in ORIG, j in DEST}:
sum {p in PROD} Trans[i,j,p] >= minload * Use[i,j];
subject to Max_Serve {i in ORIG}:
sum {j in DEST} Use[i,j] <= maxserve;
Multicommodity Transportation
29. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
31
AMPL Formulation
Explicit data independent of symbolic model
set ORIG := GARY CLEV PITT ;
set DEST := FRA DET LAN WIN STL FRE LAF ;
set PROD := bands coils plate ;
param supply (tr): GARY CLEV PITT :=
bands 400 700 800
coils 800 1600 1800
plate 200 300 300 ;
param demand (tr):
FRA DET LAN WIN STL FRE LAF :=
bands 300 300 100 75 650 225 250
coils 500 750 400 250 950 850 500
plate 100 100 0 50 200 100 250 ;
param limit default 625 ;
param minload := 375 ;
param maxserve := 5 ;
Multicommodity Transportation
30. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
32
AMPL Formulation
Explicit data (continued)
param vcost :=
[*,*,bands]: FRA DET LAN WIN STL FRE LAF :=
GARY 30 10 8 10 11 71 6
CLEV 22 7 10 7 21 82 13
PITT 19 11 12 10 25 83 15
[*,*,coils]: FRA DET LAN WIN STL FRE LAF :=
GARY 39 14 11 14 16 82 8
CLEV 27 9 12 9 26 95 17
PITT 24 14 17 13 28 99 20
[*,*,plate]: FRA DET LAN WIN STL FRE LAF :=
GARY 41 15 12 16 17 86 8
CLEV 29 9 13 9 28 99 18
PITT 26 14 17 13 31 104 20 ;
param fcost: FRA DET LAN WIN STL FRE LAF :=
GARY 3000 1200 1200 1200 2500 3500 2500
CLEV 2000 1000 1500 1200 2500 3000 2200
PITT 2000 1200 1500 1500 2500 3500 2200 ;
Multicommodity Transportation
31. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
33
AMPL Solution
Model + data = problem instance to be solved
ampl: model multmip3.mod;
ampl: data multmip3.dat;
ampl: option solver gurobi;
ampl: solve;
Gurobi 7.0.0: optimal solution; objective 235625
332 simplex iterations
23 branch-and-cut nodes
ampl: display Use;
Use [*,*]
: DET FRA FRE LAF LAN STL WIN :=
CLEV 1 1 1 0 1 1 0
GARY 0 0 0 1 0 1 1
PITT 1 1 1 1 0 1 0
;
Multicommodity Transportation
32. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
34
AMPL Solution
Solver choice independent of model and data
ampl: model multmip3.mod;
ampl: data multmip3.dat;
ampl: option solver cplex;
ampl: solve;
CPLEX 12.7.0.0: optimal integer solution; objective 235625
135 MIP simplex iterations
0 branch-and-bound nodes
ampl: display Use;
Use [*,*]
: DET FRA FRE LAF LAN STL WIN :=
CLEV 1 1 1 0 1 1 0
GARY 0 0 0 1 0 1 1
PITT 1 1 1 1 0 1 0
;
Multicommodity Transportation
33. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
35
AMPL Solution
Solver choice independent of model and data
ampl: model multmip3.mod;
ampl: data multmip3.dat;
ampl: option solver xpress;
ampl: solve;
XPRESS 29.01: Global search complete
Best integer solution found 235625
4 integer solutions have been found, 7 branch and bound nodes
ampl: display Use;
Use [*,*]
: DET FRA FRE LAF LAN STL WIN :=
CLEV 1 1 1 0 1 1 0
GARY 0 0 0 1 0 1 1
PITT 1 1 1 1 0 1 0
;
Multicommodity Transportation
34. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
36
AMPL Solution
Examine results
ampl: display {i in ORIG, j in DEST}
ampl? sum {p in PROD} Trans[i,j,p] / limit[i,j];
: DET FRA FRE LAF LAN STL WIN :=
CLEV 1 0.6 0.88 0 0.8 0.88 0
GARY 0 0 0 0.64 0 1 0.6
PITT 0.84 0.84 1 0.96 0 1 0
;
ampl: display Max_Serve.body;
CLEV 5
GARY 3
PITT 5
;
ampl: display TotalCost,
ampl? sum {i in ORIG, j in DEST} fcost[i,j] * Use[i,j];
TotalCost = 235625
sum {i in ORIG, j in DEST} fcost[i,j]*Use[i,j] = 27600
Multicommodity Transportation
35. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
37
AMPL IDE
Multicommodity Transportation
36. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Extend modeling language syntax . . .
Algebraic expressions
Set indexing expressions
Interactive commands
. . . with programming concepts
Loops of various kinds
If-then and If-then-else conditionals
Assignments
40
Scripting
37. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Run AMPL from your programs
Transfer data to and from AMPL
Execute AMPL commands within your application
Access all available solvers
Use popular programming languages
C++, C#, Java, MATLAB, Python, R
Use Python dictionaries, R dataframes, MATLAB matrices, etc.
41
APIs
38. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
43
Optimization in the Cloud
Optimization on demand
NEOS Server
Satalia SolveEngine
IBM Decision Optimization on Cloud
Optimization to order
Gurobi Instant Cloud
Collaborative optimization
QuanDec
^
39. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
44
NEOS Server www.neos-server.org
Network Enabled Optimization System
Originated 1995 at Argonne National Laboratory
and Northwestern University
U.S. Department of Energy
National Science Foundation
Since 2011 at University of Wisconsin, Madison
Wisconsin Institutes for Discovery
Free “optimization on demand”
Over 40 solvers
Several optimization modeling languages
40. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
46
Architecture
Distributed workstations
Offer varied inputs & solvers
Process submissions on demand
Contributed by varied organizations
Central scheduler
Receives and queues submissions
Sends submissions to appropriate workstations
Returns results
Minimal hands-on management
Distributed: Install NEOS software on workstations
Central: Update server database
of workstation locations and abilities
NEOS Server
41. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
47
Original Facilities
Local submission clients
Email
Website
NEOS submission tool
Problem description formats
Linear: MPS and other solver files
Nonlinear: Fortran or C programs
automatic differentiation of programs
W. Gropp and J.J. Moré, 1997. Optimization Environments and the
NEOS Server. Approximation Theory and Optimization, M. D. Buhmann and A.
Iserles, eds., Cambridge University Press, 167-182.
J. Czyzyk, M.P. Mesnier and J.J. Moré, 1998. The NEOS Server.
IEEE Journal on Computational Science and Engineering 5(3), 68-75.
NEOS Server
42. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
48
Impact: Total Submissions
Monthly rates since 1999
NEOS Server
45000/month one per minute
Peak day: 29 Sep 2013
144890 100 per minute
43. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
49
Impact: Recent Submissions
Monthly rates for past two years
NEOS Server
45000/month one per minute
44. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
50
Assessment
Strengths
Free
Choice of solvers
Every popular solver available
Easy to use
No account setup
No advance scheduling
Weaknesses
Stand-alone focus: submission of “solve jobs”
Non-profit management
Limited support & development
No guarantee of confidentiality
No guarantee of performance
NEOS Server
45. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
52
Modeling Languages in NEOS
Modeling language inputs
AMPL model, data, commands files
GAMS model, options, gdx files
Modeling language operation
User chooses a solver and a language
NEOS scheduler finds a compatible workstation
NEOS workstation invokes
modeling language system with given inputs
Modeling language system invokes solver
E.D. Dolan, R. Fourer, J.J. Moré and T.S. Munson,
Optimization on the NEOS Server. SIAM News 35:6
(July/August 2002) 4, 8–9. www.siam.org/pdf/news/457.pdf
NEOS Server
46. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
53
Impact: Modeling Languages
NEOS Server
Monthly rates since 2011
47. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Solver & Language Listing
NEOS Server
54
48. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Input Page for CPLEX using AMPL
NEOS Server
55
49. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Input Page (cont’d)
NEOS Server
56
50. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Queue Page
NEOS Server
57
51. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Output Page
NEOS Server
58
52. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
Output Page (cont’d)
NEOS Server
59
53. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
61
APIs
Application programming interfaces
Access NEOS from a local program
Implementations
Version 1: XML-RPC remote procedure call
Version 5: full Python API
Uses
NEOS submission tool
NEOS option in Solver Studio for Excel
NEOS as a “solver” for modeling systems
NEOS Server
54. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
62
Modeling Systems as NEOS Clients
New “solvers”
Kestrel for AMPL
Kestrel for GAMS
Familiar operation
Choose Kestrel as the local “solver”
Set an option to choose a real solver on NEOS
Initiate a solve and wait for results
E.D. Dolan, R. Fourer, J.-P. Goux, T.S. Munson and J. Sarich,
Kestrel: An Interface from Optimization Modeling Systems
to the NEOS Server. INFORMS Journal on Computing 20
(2008) 525–538. dx.doi.org/10.1287/ijoc.1080.0264
NEOS Server
55. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
63
AMPL Interactive Session
NEOS Server
ampl: model sched1.mod;
ampl: data sched.dat;
ampl: let least_assign := 16;
ampl: option solver kestrel;
ampl: option kestrel_options 'solver=cplex';
ampl: solve;
Connecting to: neos‐server.org:3332
Job 4679195 submitted to NEOS, password='JMNRQoTD'
Check the following URL for progress report :
http://neos‐server.org/neos/cgi‐bin/nph‐neos‐
solver.cgi?admin=results&jobnumber=4679195&pass=JMNRQoTD
Job 4679195 dispatched
password: JMNRQoTD
‐‐‐‐‐‐‐‐‐‐ Begin Solver Output ‐‐‐‐‐‐‐‐‐‐‐
Job submitted to NEOS HTCondor pool.
57. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
65
Kestrel Impact
NEOS Server
Intensive use in short bursts
Peaks of 10,000-60,000 per day
Modest use on average
Average of 3,570 per month over past year
Mostly AMPL/CPLEX
58. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
66
Kestrel Assessment
Strengths
Powerful local client for modeling
NEOS facilities for solving
Weaknesses
Not all NEOS solvers available
Local solver software is strong competition . . .
Bundled with modeling languages
Free for trial use
Free for course and academic use
Limited support & development
Solver logs not currently returned
. . . we provide support for Kestrel/AMPL
NEOS Server
59. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
67
Recent Developments
Intensified support
Shift to HTCondor “high-throughput” platforms
Updated Kestrel client
Updated solver offerings
User accounts
Higher priority for job scheduling
“My Jobs” tab listing recent jobs & links to results
NEOS Server
60. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
68
A Commercial NEOS?
61. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
69
Satalia SolveEngine
62. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
70
Satalia SolveEngine
63. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
71
Satalia SolveEngine
64. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
72
A Solver-Specific NEOS?
65. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
73
IBM Decision Optimization on Cloud
DOcplexcloud API
Analogous to NEOS Python API
DropSolve service
Similar to NEOS web services
Matrix formats: LP, SAV, and MPS files
OPL modeling language: MOD and DAT files
Python programs using the API
IBM solvers
CPLEX
CP optimizer
See also FICO Analytic Cloud for Xpress solver
66. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
75
Gurobi Instant Cloud cloud.gurobi.com
Client side
Standard Gurobi installation
Cloud license
Server side
Compute server for Gurobi solver
Single-machine solves
Distributed MIP solves
Distributed tuning
Server pools with load balancing
. . . hosted on Amazon Web Services
“Cloud computing technology is changing quickly.
Please check these documents periodically to ensure
you have the latest instructions for the Gurobi Cloud.”
67. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
76
Gurobi Instant Cloud for AMPL
Client side
AMPL installation (command-line or IDE)
Standard Gurobi-for-AMPL installation
Server side
Gurobi compute server
Gurobi optimizer
68. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
77
cloud.gurobi.com
Gurobi Instant Cloud
69. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
78
cloud.gurobi.com
Gurobi Instant Cloud
70. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
79
www.gurobi.com
Gurobi Instant Cloud
71. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
80
View Available Licenses
Gurobi Instant Cloud
72. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
81
Get Gurobi License File
Gurobi Instant Cloud
# This is a license file created by the Gurobi Instant Cloud
# Created on Mon, 17 Oct 2016 20:46:26 GMT
# License Id: 142032
# Place this file in your home directory or one of the following
# locations where XXX is the Gurobi Optimizer version you are using:
# * C:gurobi or C:gurobiXXX on Windows
# * /opt/gurobi/ or /opt/gurobiXXX/ on Linux
# * /Library/gurobi/ or /Library/gurobiXXX/ on Mac OS X
# Or set environment variable GRB_LICENSE_FILE to point to this file
# Do not share this license file because it contains your secret key
CLOUDACCESSID=fedf3901‐04f1‐44d7‐9725‐e36c1c3f70f6
CLOUDKEY=0v9XdWrDQLiE3EiAAEKtFw
CLOUDHOST=ngcloud.gurobi.com
73. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
82
Use with AMPL: Setup
Gurobi Instant Cloud
ampl: model multmip3.mod;
ampl: data multmip3.dat;
ampl: option solver gurobi;
ampl: option gurobi_options
ampl? 'cloudid=fedf3901‐04f1‐44d7‐9725‐e36c1c3f70f6
ampl? cloudkey=0v9XdWrDQLiE3EiAAEKtFw';
ampl:
74. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
83
Use with AMPL: Startup
Gurobi Instant Cloud
ampl: model multmip3.mod;
ampl: data multmip3.dat;
ampl: option solver gurobi;
ampl: option gurobi_options
ampl? 'cloudid=fedf3901‐04f1‐44d7‐9725‐e36c1c3f70f6
ampl? cloudkey=0v9XdWrDQLiE3EiAAEKtFw';
ampl: solve;
Gurobi 7.0.0: cloudid=fedf3901‐04f1‐44d7‐9725‐e36c1c3f70f6
cloudkey=0v9XdWrDQLiE3EiAAEKtFw
Waiting for cloud server to start..........
75. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
84
Use with AMPL: Solve
Gurobi Instant Cloud
ampl: model multmip3.mod;
ampl: data multmip3.dat;
ampl: option solver gurobi;
ampl: option gurobi_options
ampl? 'cloudid=fedf3901‐04f1‐44d7‐9725‐e36c1c3f70f6
ampl? cloudkey=0v9XdWrDQLiE3EiAAEKtFw';
ampl: solve;
Gurobi 7.0.0: cloudid=fedf3901‐04f1‐44d7‐9725‐e36c1c3f70f6
cloudkey=0v9XdWrDQLiE3EiAAEKtFw
Waiting for cloud server to start.............
Capacity available on 'default' cloud pool ‐ connecting...
Established 256‐bit AES encrypted connection
Gurobi 7.0.0: optimal solution; objective 235625
289 simplex iterations
25 branch‐and‐cut nodes
plus 35 simplex iterations for intbasis
ampl:
76. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
85
Use with AMPL: Continue
Gurobi Instant Cloud
ampl: display {i in ORIG, j in DEST} sum {p in PROD} Trans[i,j,p];
: DET FRA FRE LAF LAN STL WIN :=
CLEV 625 375 550 0 500 550 0
GARY 0 0 0 400 0 625 375
PITT 525 525 625 600 0 625 0
;
ampl: reset data;
ampl: data multmip3a.dat;
ampl: solve;
Gurobi 7.0.0: cloudid=fedf3901‐04f1‐44d7‐9725‐e36c1c3f70f6
cloudkey=0v9XdWrDQLiE3EiAAEKtFw
Capacity available on 'default' cloud pool ‐ connecting...
Established 256‐bit AES encrypted connection
Gurobi 7.0.0: optimal solution; objective 238450
163 simplex iterations
plus 33 simplex iterations for intbasis
ampl:
77. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
87
Manage Server Configuration
Gurobi Instant Cloud
78. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
88
Check Costs
Gurobi Instant Cloud
79. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
89
Gurobi Cloud Costs
Commercial plans
Annual subscription fee, plus
Hourly rates for use:
Gurobi rate for compute servers
Amazon rate for distributed workers
Trials, academic use, special grants
Amazon rate only
. . . set up through sales rep
80. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
90
Gurobi Cloud for AMPL: Assessment
Strengths
Security
Reliability (via Amazon)
Support for multi-server and/or multi-worker pools
Support for local modeling clients
Drawbacks (compared to NEOS)
Not free
Budgeting can be complicated
Solver-specific
Not quite “optimization on demand”
81. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
91
QuanDec
Server side
AMPL model and data
Standard AMPL-solver installations
Client side
Interactive tool for collaboration & decision-making
Runs on any recent web browser
Java-based implementation
AMPL API for Java
Eclipse Remote Application Platform
. . . developed / supported by Cassotis Consulting
82. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
92
Initialization
Prepare the model and data
Add reporting variables to the model
Select initial data in AMPL .dat format
Import to QuanDec
Install on a server
Read zipfile of model and data
Create new application and first master problem
Configure displays
Create data tables
Adjust views
. . . mostly done automatically
QuanDec
83. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
The web-based graphical interface that
turns optimization models written in
AMPL into decision-making tools
93
84. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
scenario #1
scenario #2
scenario #3
scenario #4
#2 #3
reports import /
export to
Excel® comparison
sensitivity
analysis
pre‐defined
analysis
Server application
Centralized data
Several apps on a single
instance
Web‐based
Multi‐users
Concurrent access
Secure access
Scenario‐based
Sharing between users
Sharing rights
(edit / comment/ view)
And much more…
regression
Features
94
88. Quandec’s value proposition
Intuitive &
user-friendly
Benefit from all AMPL
language features
Recurrent decisions based
on the result of analyses
(scripts)
Run optimization in
various conditions
(scenarios)
No need of knowledge
in Operations Research
to be an end userGUI creation in less
than 2 days, without
any programming
No proprietary
format: use your
preferred editor
and use any good
versioning system
98
90. Fourer, Brandão, Laskowski, AMPL in the Cloud
INFORMS Analytics, Baltimore, 15-17 April 2017
QuanDec Availability
Contact sales@ampl.com
Free trials available
Pricing keyed to number of models & users
First year’s support included
Tailored setup support from Cassotis Consulting
Customizations possible
100