An exploration of serverless Go. Specifically focussing on AWS and tools such as Apex and Up. Extra material can be found here: https://mhemmings.co.uk/blog/go-serverless-golangne/
Serverless Application Model - Executing Lambdas LocallyAlex
A slide deck presenting the Serverless Application Model (SAM). Examples running lambda functions locally with a local DynamoDB. Presented as a lightning talk to the AWS DC Meetup in May 2018.
Presenter: Alex
Company: SpicyKey LLC
@spicykey
N.b. SAM is hosted on github - https://github.com/awslabs/aws-sam-local
Those are the decks used to explain API Gateway + Lambda + internal load balancer integration. AWS meetup, Cordoba Argentina.
Follow us
https://dinocloudconsulting.com/
https://www.facebook.com/dinocloudcons
https://www.instagram.com/dinocloud_/
https://twitter.com/dinocloud_
Serverless Application Model - Executing Lambdas LocallyAlex
A slide deck presenting the Serverless Application Model (SAM). Examples running lambda functions locally with a local DynamoDB. Presented as a lightning talk to the AWS DC Meetup in May 2018.
Presenter: Alex
Company: SpicyKey LLC
@spicykey
N.b. SAM is hosted on github - https://github.com/awslabs/aws-sam-local
Those are the decks used to explain API Gateway + Lambda + internal load balancer integration. AWS meetup, Cordoba Argentina.
Follow us
https://dinocloudconsulting.com/
https://www.facebook.com/dinocloudcons
https://www.instagram.com/dinocloud_/
https://twitter.com/dinocloud_
Performance Monitoring with AOP and Amazon CloudWatchYan Cui
This talk outlines how to easily set up pseudo-RT performance monitoring for your application using an AOP framework such as PostSharp in conjunction with the Amazon CloudWatch service.
I used this slide on my 02nd AWS meetup at Habib university Karachi , Pakistan
13th April 2019
www.academy.sherdil.org
We are the only multi cloud training provider in Pakistan
Meanwhile some people are still moving from pets to cattle the next innovation seems to be no servers at all (serverless architecture). In this field Amazon offers their Lambda service and here you'll learn its power and limits. Are they really limits? How many of them can we circumvent?
This technology fits very well the use case of system administrator tooling because we are too busy taking care of legacy systems and other hidden elephants. We must give an example of how far can we go, and what a better way than developing serverless infrastructure code.
Choosing the right messaging service for your serverless app [with lumigo]Dhaval Nagar
By their nature, serverless applications are highly-distributed and event-driven, relying heavily on relaying events from one service to another. With that in mind, selecting the right messaging service for routing events is critical for your serverless application's functionality and performance.
I reviewed the three major event-routing services on AWS -- SNS, SQS, and EventBridge. Also, examine their differences and which service is optimal for which use case.
Finally, looked at the best way to monitor and debug a serverless application that uses an event-routing messaging service
Serverless needs no introduction these days. It is viewed as a magic recipe for organisations moving to cloud and for those moving beyond the container hell.
LEGO.com was migrated from a legacy monolith eCommerce platform onto serverless on AWS. This employed serverless and managed services at its core within an agile development process. Is early success with serverless a springboard to future possibilities? Does serverless really deliver what it promises?
We will look at how serverless helped in the migration and what can it do to the organisation beyond its initial adoption!
--This presentation was presented in Serverless Summit - www.inserverless.com ---
In this presentation I'll show you how to use Amazon Lambda and Lex to build a working chatbot in just a few minutes. No prior experience is required, you'll see how to use a simple starter kit built by myself and a friend to rapidly set up a bot. This is a great way to get your hands dirty with serverless programming on the AWS platform, and have some fun writing a bot!
Customer Case Study Containerised Bioinformatics on AWS How we Achieved 20x l...Amazon Web Services
The Garvan Institute of Medical Research and Genome.One undertook a joint pilot project with AWS to optimise and customise our genomic analysis. We have run over 4,500 genomes through a new genomic pipeline, developed to the Broad Institute Best Practices leveraging Amazon’s ECS, SQS, RDS, CloudFormation, CloudWatch and Spot Instances to optimise specifically for the cloud. This session will present our architecture, learnings, and the cost reductions we’ve achieved.
Speaker: Dr. Liviu Constantinescu, DevOps Team Lead, Genome.One
Level: 300
These are the slides of the second talk of the second Tech Talk@TransferWise Singapore, which happened on the 1st of March 2018.
We take a look at what Serverless Computing is, find out what we can do with Amazon Web Services Lambda and when it can be useful. We also explore how it has evolved for the past 3 years and learn about its remaining limitations.
AWS Lambda Containers - bridging the gap between serverless and containers on...Yun Zhi Lin
Video: https://youtu.be/Zg8jrAOfqEY
Feb 2021 Sydney Serverless Meetup talk on AWS Lambda Containers - bridging the gap between serverless and containers once and for all
The serverless paradigm focuses on business problems and containers are the infrastructure abstraction of choice for most developers. With AWS Lambda container support, it is now possible to combine the two worlds to focus on business problems with the certainty of immutable infrastructure and unprecedented levels of code flexibility/portability. What does this brave new world of serverless containers on AWS looks like? How easy is it to implement/migrate? Which use cases are suitable? Let’s dive deep and find out!
How LogicMonitor Automates Deployments with Bamboo and AnsibleRandall Thomson
LogicMonitor build a standardized software deployment process using Bamboo and Ansible with integrations to HipChat and the LogicMonitor API. This talk covers how we empowered our developers to deploy software in a consistent process to Production.
Get the EDGE to scale: Using Cloudfront along with edge compute to scale your...Amazon Web Services
You could use Cloud Front to deliver pages faster, however, customized processing still required requests to be forwarded back to compute resources at centralized servers, which may slow down the end user experience. This session shows how a combination of Cloud Front, and edge compute can help you scale out your resources in a much more effective way than you think.
Speaker: Anil Nair
Solution Architect, Amazon India
Performance Monitoring with AOP and Amazon CloudWatchYan Cui
This talk outlines how to easily set up pseudo-RT performance monitoring for your application using an AOP framework such as PostSharp in conjunction with the Amazon CloudWatch service.
I used this slide on my 02nd AWS meetup at Habib university Karachi , Pakistan
13th April 2019
www.academy.sherdil.org
We are the only multi cloud training provider in Pakistan
Meanwhile some people are still moving from pets to cattle the next innovation seems to be no servers at all (serverless architecture). In this field Amazon offers their Lambda service and here you'll learn its power and limits. Are they really limits? How many of them can we circumvent?
This technology fits very well the use case of system administrator tooling because we are too busy taking care of legacy systems and other hidden elephants. We must give an example of how far can we go, and what a better way than developing serverless infrastructure code.
Choosing the right messaging service for your serverless app [with lumigo]Dhaval Nagar
By their nature, serverless applications are highly-distributed and event-driven, relying heavily on relaying events from one service to another. With that in mind, selecting the right messaging service for routing events is critical for your serverless application's functionality and performance.
I reviewed the three major event-routing services on AWS -- SNS, SQS, and EventBridge. Also, examine their differences and which service is optimal for which use case.
Finally, looked at the best way to monitor and debug a serverless application that uses an event-routing messaging service
Serverless needs no introduction these days. It is viewed as a magic recipe for organisations moving to cloud and for those moving beyond the container hell.
LEGO.com was migrated from a legacy monolith eCommerce platform onto serverless on AWS. This employed serverless and managed services at its core within an agile development process. Is early success with serverless a springboard to future possibilities? Does serverless really deliver what it promises?
We will look at how serverless helped in the migration and what can it do to the organisation beyond its initial adoption!
--This presentation was presented in Serverless Summit - www.inserverless.com ---
In this presentation I'll show you how to use Amazon Lambda and Lex to build a working chatbot in just a few minutes. No prior experience is required, you'll see how to use a simple starter kit built by myself and a friend to rapidly set up a bot. This is a great way to get your hands dirty with serverless programming on the AWS platform, and have some fun writing a bot!
Customer Case Study Containerised Bioinformatics on AWS How we Achieved 20x l...Amazon Web Services
The Garvan Institute of Medical Research and Genome.One undertook a joint pilot project with AWS to optimise and customise our genomic analysis. We have run over 4,500 genomes through a new genomic pipeline, developed to the Broad Institute Best Practices leveraging Amazon’s ECS, SQS, RDS, CloudFormation, CloudWatch and Spot Instances to optimise specifically for the cloud. This session will present our architecture, learnings, and the cost reductions we’ve achieved.
Speaker: Dr. Liviu Constantinescu, DevOps Team Lead, Genome.One
Level: 300
These are the slides of the second talk of the second Tech Talk@TransferWise Singapore, which happened on the 1st of March 2018.
We take a look at what Serverless Computing is, find out what we can do with Amazon Web Services Lambda and when it can be useful. We also explore how it has evolved for the past 3 years and learn about its remaining limitations.
AWS Lambda Containers - bridging the gap between serverless and containers on...Yun Zhi Lin
Video: https://youtu.be/Zg8jrAOfqEY
Feb 2021 Sydney Serverless Meetup talk on AWS Lambda Containers - bridging the gap between serverless and containers once and for all
The serverless paradigm focuses on business problems and containers are the infrastructure abstraction of choice for most developers. With AWS Lambda container support, it is now possible to combine the two worlds to focus on business problems with the certainty of immutable infrastructure and unprecedented levels of code flexibility/portability. What does this brave new world of serverless containers on AWS looks like? How easy is it to implement/migrate? Which use cases are suitable? Let’s dive deep and find out!
How LogicMonitor Automates Deployments with Bamboo and AnsibleRandall Thomson
LogicMonitor build a standardized software deployment process using Bamboo and Ansible with integrations to HipChat and the LogicMonitor API. This talk covers how we empowered our developers to deploy software in a consistent process to Production.
Get the EDGE to scale: Using Cloudfront along with edge compute to scale your...Amazon Web Services
You could use Cloud Front to deliver pages faster, however, customized processing still required requests to be forwarded back to compute resources at centralized servers, which may slow down the end user experience. This session shows how a combination of Cloud Front, and edge compute can help you scale out your resources in a much more effective way than you think.
Speaker: Anil Nair
Solution Architect, Amazon India
What does Serverless mean for DevOps, in practical terms? While Serverless does reduce the need for server-centric DevOps, it poses new challenges in many areas including security, app deployment and cloud resource provisioning, partly due to an explosion of "nanoservices". Based on a current project using AWS, we cover relevant tools, techniques and tips to deliver a smooth serverless experience for development through to production.
Delivered at Bristol DevOps meetup, 27 Jun 2018. To see detailed notes covering extra points not on slides, click the Notes link just below (or download the Powerpoint).
Update: here's the correct link for Gojko Adzic talk on the Backendless slide - https://www.youtube.com/watch?v=w7X4gAQTk2E
Reuven Lerner's first talk from Open Ruby Day, at Hi-Tech College in Herzliya, Israel, on June 27th 2010. An overview of what makes Rails a powerful framework for Web development -- what attracted Reuven to it, what are the components that most speak to him, and why others should consider Rails for their Web applications.
Serverless Computing with Azure Functions and XamarinMark Arteaga
[Presentation Given to Developer Usergroups - Source code available here https://github.com/redbitdev/RedBit.XamServerless]
Are you spending your day in Visual Studio? Are you curious about developing mobile apps for iOS and Android using Xamarin but not sure where to get started? Or interested in how you can leverage serverless computing? Then this session is for you!
During this session we will cover high level what is ‘serverless’ computing, how to build native iOS and Android apps using C#, how to share that code across the two platforms and how to connect that Xamarin App to a serverless computing environment.
We will work through a sample application built using Xamarin Forms and how to integrate this app with Azure Functions.
by Rahul Sareen, Sr. IoT Consultant, AWS Professional Services
Serverless computing allows you to build and run applications without the need for provisioning or managing servers. With serverless computing, you can build web, mobile, and IoT backends; run stream processing or big data workloads; run chatbots, and more. In this session, you’ll learn how to get started with serverless computing with AWS Lambda, which lets you run code without provisioning or managing servers. We’ll introduce you to the basics of building with Lambda and how you can benefit from features such as continuous scaling, built-in high availability, integrations with AWS and third-party apps, and subsecond metering pricing. We’ll also introduce you to the broader portfolio of AWS services that help you build serverless applications with Lambda, including Amazon API Gateway, Amazon DynamoDB, AWS Step Functions, and more.
Trent Hornibrook gave a recent talk at the Infracoders meet-up playing a thought experiment with the audience on 'what would be your tech decisions if you were given a blank cheque at at startup'.
Trent, recently working for a start-up then shared what decisions he made, and why
Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...Hivelance Technology
Cryptocurrency trading bots are computer programs designed to automate buying, selling, and managing cryptocurrency transactions. These bots utilize advanced algorithms and machine learning techniques to analyze market data, identify trading opportunities, and execute trades on behalf of their users. By automating the decision-making process, crypto trading bots can react to market changes faster than human traders
Hivelance, a leading provider of cryptocurrency trading bot development services, stands out as the premier choice for crypto traders and developers. Hivelance boasts a team of seasoned cryptocurrency experts and software engineers who deeply understand the crypto market and the latest trends in automated trading, Hivelance leverages the latest technologies and tools in the industry, including advanced AI and machine learning algorithms, to create highly efficient and adaptable crypto trading bots
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns
Unlocking Business Potential: Tailored Technology Solutions by Prosigns
Discover how Prosigns, a leading technology solutions provider, partners with businesses to drive innovation and success. Our presentation showcases our comprehensive range of services, including custom software development, web and mobile app development, AI & ML solutions, blockchain integration, DevOps services, and Microsoft Dynamics 365 support.
Custom Software Development: Prosigns specializes in creating bespoke software solutions that cater to your unique business needs. Our team of experts works closely with you to understand your requirements and deliver tailor-made software that enhances efficiency and drives growth.
Web and Mobile App Development: From responsive websites to intuitive mobile applications, Prosigns develops cutting-edge solutions that engage users and deliver seamless experiences across devices.
AI & ML Solutions: Harnessing the power of Artificial Intelligence and Machine Learning, Prosigns provides smart solutions that automate processes, provide valuable insights, and drive informed decision-making.
Blockchain Integration: Prosigns offers comprehensive blockchain solutions, including development, integration, and consulting services, enabling businesses to leverage blockchain technology for enhanced security, transparency, and efficiency.
DevOps Services: Prosigns' DevOps services streamline development and operations processes, ensuring faster and more reliable software delivery through automation and continuous integration.
Microsoft Dynamics 365 Support: Prosigns provides comprehensive support and maintenance services for Microsoft Dynamics 365, ensuring your system is always up-to-date, secure, and running smoothly.
Learn how our collaborative approach and dedication to excellence help businesses achieve their goals and stay ahead in today's digital landscape. From concept to deployment, Prosigns is your trusted partner for transforming ideas into reality and unlocking the full potential of your business.
Join us on a journey of innovation and growth. Let's partner for success with Prosigns.
Into the Box Keynote Day 2: Unveiling amazing updates and announcements for modern CFML developers! Get ready for exciting releases and updates on Ortus tools and products. Stay tuned for cutting-edge innovations designed to boost your productivity.
How to Position Your Globus Data Portal for Success Ten Good PracticesGlobus
Science gateways allow science and engineering communities to access shared data, software, computing services, and instruments. Science gateways have gained a lot of traction in the last twenty years, as evidenced by projects such as the Science Gateways Community Institute (SGCI) and the Center of Excellence on Science Gateways (SGX3) in the US, The Australian Research Data Commons (ARDC) and its platforms in Australia, and the projects around Virtual Research Environments in Europe. A few mature frameworks have evolved with their different strengths and foci and have been taken up by a larger community such as the Globus Data Portal, Hubzero, Tapis, and Galaxy. However, even when gateways are built on successful frameworks, they continue to face the challenges of ongoing maintenance costs and how to meet the ever-expanding needs of the community they serve with enhanced features. It is not uncommon that gateways with compelling use cases are nonetheless unable to get past the prototype phase and become a full production service, or if they do, they don't survive more than a couple of years. While there is no guaranteed pathway to success, it seems likely that for any gateway there is a need for a strong community and/or solid funding streams to create and sustain its success. With over twenty years of examples to draw from, this presentation goes into detail for ten factors common to successful and enduring gateways that effectively serve as best practices for any new or developing gateway.
How Recreation Management Software Can Streamline Your Operations.pptxwottaspaceseo
Recreation management software streamlines operations by automating key tasks such as scheduling, registration, and payment processing, reducing manual workload and errors. It provides centralized management of facilities, classes, and events, ensuring efficient resource allocation and facility usage. The software offers user-friendly online portals for easy access to bookings and program information, enhancing customer experience. Real-time reporting and data analytics deliver insights into attendance and preferences, aiding in strategic decision-making. Additionally, effective communication tools keep participants and staff informed with timely updates. Overall, recreation management software enhances efficiency, improves service delivery, and boosts customer satisfaction.
A Comprehensive Look at Generative AI in Retail App Testing.pdfkalichargn70th171
Traditional software testing methods are being challenged in retail, where customer expectations and technological advancements continually shape the landscape. Enter generative AI—a transformative subset of artificial intelligence technologies poised to revolutionize software testing.
Cyaniclab : Software Development Agency Portfolio.pdfCyanic lab
CyanicLab, an offshore custom software development company based in Sweden,India, Finland, is your go-to partner for startup development and innovative web design solutions. Our expert team specializes in crafting cutting-edge software tailored to meet the unique needs of startups and established enterprises alike. From conceptualization to execution, we offer comprehensive services including web and mobile app development, UI/UX design, and ongoing software maintenance. Ready to elevate your business? Contact CyanicLab today and let us propel your vision to success with our top-notch IT solutions.
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisGlobus
JASMIN is the UK’s high-performance data analysis platform for environmental science, operated by STFC on behalf of the UK Natural Environment Research Council (NERC). In addition to its role in hosting the CEDA Archive (NERC’s long-term repository for climate, atmospheric science & Earth observation data in the UK), JASMIN provides a collaborative platform to a community of around 2,000 scientists in the UK and beyond, providing nearly 400 environmental science projects with working space, compute resources and tools to facilitate their work. High-performance data transfer into and out of JASMIN has always been a key feature, with many scientists bringing model outputs from supercomputers elsewhere in the UK, to analyse against observational or other model data in the CEDA Archive. A growing number of JASMIN users are now realising the benefits of using the Globus service to provide reliable and efficient data movement and other tasks in this and other contexts. Further use cases involve long-distance (intercontinental) transfers to and from JASMIN, and collecting results from a mobile atmospheric radar system, pushing data to JASMIN via a lightweight Globus deployment. We provide details of how Globus fits into our current infrastructure, our experience of the recent migration to GCSv5.4, and of our interest in developing use of the wider ecosystem of Globus services for the benefit of our user community.
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Globus
The Earth System Grid Federation (ESGF) is a global network of data servers that archives and distributes the planet’s largest collection of Earth system model output for thousands of climate and environmental scientists worldwide. Many of these petabyte-scale data archives are located in proximity to large high-performance computing (HPC) or cloud computing resources, but the primary workflow for data users consists of transferring data, and applying computations on a different system. As a part of the ESGF 2.0 US project (funded by the United States Department of Energy Office of Science), we developed pre-defined data workflows, which can be run on-demand, capable of applying many data reduction and data analysis to the large ESGF data archives, transferring only the resultant analysis (ex. visualizations, smaller data files). In this talk, we will showcase a few of these workflows, highlighting how Globus Flows can be used for petabyte-scale climate analysis.
Accelerate Enterprise Software Engineering with PlatformlessWSO2
Key takeaways:
Challenges of building platforms and the benefits of platformless.
Key principles of platformless, including API-first, cloud-native middleware, platform engineering, and developer experience.
How Choreo enables the platformless experience.
How key concepts like application architecture, domain-driven design, zero trust, and cell-based architecture are inherently a part of Choreo.
Demo of an end-to-end app built and deployed on Choreo.
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Globus
Large Language Models (LLMs) are currently the center of attention in the tech world, particularly for their potential to advance research. In this presentation, we'll explore a straightforward and effective method for quickly initiating inference runs on supercomputers using the vLLM tool with Globus Compute, specifically on the Polaris system at ALCF. We'll begin by briefly discussing the popularity and applications of LLMs in various fields. Following this, we will introduce the vLLM tool, and explain how it integrates with Globus Compute to efficiently manage LLM operations on Polaris. Attendees will learn the practical aspects of setting up and remotely triggering LLMs from local machines, focusing on ease of use and efficiency. This talk is ideal for researchers and practitioners looking to leverage the power of LLMs in their work, offering a clear guide to harnessing supercomputing resources for quick and effective LLM inference.
Modern design is crucial in today's digital environment, and this is especially true for SharePoint intranets. The design of these digital hubs is critical to user engagement and productivity enhancement. They are the cornerstone of internal collaboration and interaction within enterprises.
In software engineering, the right architecture is essential for robust, scalable platforms. Wix has undergone a pivotal shift from event sourcing to a CRUD-based model for its microservices. This talk will chart the course of this pivotal journey.
Event sourcing, which records state changes as immutable events, provided robust auditing and "time travel" debugging for Wix Stores' microservices. Despite its benefits, the complexity it introduced in state management slowed development. Wix responded by adopting a simpler, unified CRUD model. This talk will explore the challenges of event sourcing and the advantages of Wix's new "CRUD on steroids" approach, which streamlines API integration and domain event management while preserving data integrity and system resilience.
Participants will gain valuable insights into Wix's strategies for ensuring atomicity in database updates and event production, as well as caching, materialization, and performance optimization techniques within a distributed system.
Join us to discover how Wix has mastered the art of balancing simplicity and extensibility, and learn how the re-adoption of the modest CRUD has turbocharged their development velocity, resilience, and scalability in a high-growth environment.
Your Digital Assistant.
Making complex approach simple. Straightforward process saves time. No more waiting to connect with people that matter to you. Safety first is not a cliché - Securely protect information in cloud storage to prevent any third party from accessing data.
Would you rather make your visitors feel burdened by making them wait? Or choose VizMan for a stress-free experience? VizMan is an automated visitor management system that works for any industries not limited to factories, societies, government institutes, and warehouses. A new age contactless way of logging information of visitors, employees, packages, and vehicles. VizMan is a digital logbook so it deters unnecessary use of paper or space since there is no requirement of bundles of registers that is left to collect dust in a corner of a room. Visitor’s essential details, helps in scheduling meetings for visitors and employees, and assists in supervising the attendance of the employees. With VizMan, visitors don’t need to wait for hours in long queues. VizMan handles visitors with the value they deserve because we know time is important to you.
Feasible Features
One Subscription, Four Modules – Admin, Employee, Receptionist, and Gatekeeper ensures confidentiality and prevents data from being manipulated
User Friendly – can be easily used on Android, iOS, and Web Interface
Multiple Accessibility – Log in through any device from any place at any time
One app for all industries – a Visitor Management System that works for any organisation.
Stress-free Sign-up
Visitor is registered and checked-in by the Receptionist
Host gets a notification, where they opt to Approve the meeting
Host notifies the Receptionist of the end of the meeting
Visitor is checked-out by the Receptionist
Host enters notes and remarks of the meeting
Customizable Components
Scheduling Meetings – Host can invite visitors for meetings and also approve, reject and reschedule meetings
Single/Bulk invites – Invitations can be sent individually to a visitor or collectively to many visitors
VIP Visitors – Additional security of data for VIP visitors to avoid misuse of information
Courier Management – Keeps a check on deliveries like commodities being delivered in and out of establishments
Alerts & Notifications – Get notified on SMS, email, and application
Parking Management – Manage availability of parking space
Individual log-in – Every user has their own log-in id
Visitor/Meeting Analytics – Evaluate notes and remarks of the meeting stored in the system
Visitor Management System is a secure and user friendly database manager that records, filters, tracks the visitors to your organization.
"Secure Your Premises with VizMan (VMS) – Get It Now"
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Shahin Sheidaei
Games are powerful teaching tools, fostering hands-on engagement and fun. But they require careful consideration to succeed. Join me to explore factors in running and selecting games, ensuring they serve as effective teaching tools. Learn to maintain focus on learning objectives while playing, and how to measure the ROI of gaming in education. Discover strategies for pitching gaming to leadership. This session offers insights, tips, and examples for coaches, team leads, and enterprise leaders seeking to teach from simple to complex concepts.
First Steps with Globus Compute Multi-User EndpointsGlobus
In this presentation we will share our experiences around getting started with the Globus Compute multi-user endpoint. Working with the Pharmacology group at the University of Auckland, we have previously written an application using Globus Compute that can offload computationally expensive steps in the researcher's workflows, which they wish to manage from their familiar Windows environments, onto the NeSI (New Zealand eScience Infrastructure) cluster. Some of the challenges we have encountered were that each researcher had to set up and manage their own single-user globus compute endpoint and that the workloads had varying resource requirements (CPUs, memory and wall time) between different runs. We hope that the multi-user endpoint will help to address these challenges and share an update on our progress here.
Software Engineering, Software Consulting, Tech Lead.
Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Security,
Spring Transaction, Spring MVC,
Log4j, REST/SOAP WEB-SERVICES.
Understanding Globus Data Transfers with NetSageGlobus
NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?
15. Apex
• Build, deploy, and manage Lambda functions with ease
• Non-native languages
• Environments and versions
• Infrastructure management using Terraform
• Metrics, logs, and cost analysis
23. Recap
• Learn nuances
• Don’t attempt to manage in the AWS dashboard
• Roll your own? (AWS CLI, CloudFormation, Terraform, SAM)
• Apex for FaaS
• Up for web applications
• Try today!
24. Going Further
• You’ll want to do more and start managing resources together
• AWS Serverless Application Model (SAM)
