Lasta FluteをGCPにデプロイしてみた

•

0 likes•263 views

This document discusses using LastaFlute, an open source Java web framework, with Google Cloud Platform (GCP). It describes deploying a sample application called Maihama that uses GAE Standard for APIs, Cloud SQL for databases, and Firebase Hosting for client-side code. It provides links to the sample application on GitHub and discusses configuring each GCP component and deploying the application.

Technology

DBFlute
7
Java Scala Ruby PHP
Web
Web
Takeshi Kato
@_miyasama_
About me.

GCP
Google App Engine
Google Cloud SQL
Firebase Hosting

LT
lastaflute
GCP
lastaflute-example-maihama
harbar(API ) magical-camp(SPA )
GCP

https://github.com/miyasama/lastaflute-example-maihama/tree/for-
google-app-engine 
https://github.com/miyasama/lastaflute-example-maihama/pull/1 
LT

GAE Standard
(harbar)
(API )
Cloud SQL
(MySQL)
Firebase Hosting
(magical-camp)
(HTML/CSS/JS)
Firebase Hosting PJ GCP PJ

2 Google App Engine
Standard
PaaS  
memcached
Flexible
PaaS Docker
Standard
memcached

JDBC
jdbc:google:mysql://[CloudSQL ]/[DB ]

ResponseHeader
Access-Control-Allow-Headers x-authrization
Access-Control-Allow-Origin *

ResponseHeader
HangarFwAssistantDirector

src/main/webapp/WEB-INF appengine-web.xml
GAE Standard
appengine-web.xml
src/main/webapp/WEB-INF OK
xml

appengine-maven-plugin
mvn appengine:deploy GAE

appengine-maven-plugin
appengine-web.xml
GAE

Learn how to deploy a managed Presto environment to interactively query log data on AWS Organizations often need to quickly analyze large amounts of data, such as logs, generated from a wide variety of sources and formats. However, traditional approaches require a lot of time and effort designing complex data transformation and loading processes; and configuring data warehouses. Using AWS, you can start querying your datasets within minutes In this webinar you will learn how you can deploy a managed Presto environment in minutes to interactively query log data using plain ANSI SQL. Presto is a popular open source SQL engine for running interactive analytic queries against data sources of all sizes. We will talk about common use cases and best practices for running Presto on Amazon EMR. Learning Objectives: • Learn how to deploy a managed Presto environment running on Amazon EMR • Understand best practices for running Presto on Amazon EMR, including use of Amazon EC2 Spot instances • Learn how other customers are using Presto to analyze large data sets

Dataflow in 104corp - DataConTW2018

Gavin Lin

(BDT303) Running Spark and Presto on the Netflix Big Data Platform

Amazon Web Services

In this session, we discuss how Spark and Presto complement the Netflix big data platform stack that started with Hadoop, and the use cases that Spark and Presto address. Also, we discuss how we run Spark and Presto on top of the Amazon EMR infrastructure; specifically, how we use Amazon S3 as our data warehouse and how we leverage Amazon EMR as a generic framework for data-processing cluster management.

SF Big Analytics: Machine Learning with Presto by Christopher Berner

Chester Chen

Talk 1: Machine Learning in Presto Presto is an open source distributed SQL query engine used by Facebook, in our Hadoop warehouse. It's typically about 10x faster than Hive, and can be extended to a number of other use cases. One of these extensions adds SQL functions to create and make predictions with machine learning models. The aim of this is to significantly reduce the time it takes to prototype a model, by moving the construction and testing of the model to the database. Bio: Christopher Berner works as a software engineer at Facebook on the Presto team. He wrote the ML functionality, and has worked on the query planner, type system, bytecode generator, and many other pieces of Presto. Before Presto he worked on the newsfeed ranking team developing machine learning models.

(BDT403) Netflix's Next Generation Big Data Platform | AWS re:Invent 2014

Amazon Web Services

As Netflix expands their services to more countries, devices, and content, they continue to evolve their big data analytics platform to accommodate the increasing needs of product and consumer insights. This year, Netflix re-innovated their big data platform: they upgraded to Hadoop 2, transitioned to the Parquet file format, experimented with Pig on Tez for the ETL workload, and adopted Presto as their interactive querying engine. In this session, Netflix discusses their latest architecture, how they built it on the Amazon EMR infrastructure, the contributions put into the open source community, as well as some performance numbers for running a big data warehouse with Amazon S3.

Dataflow in 104corp - AWS UserGroup TW 2018

Gavin Lin

Taking deep learning models to production and doing so reliably is one of the next frontiers of MLOps. With the advent of Redis modules and the availability of C APIs for the major deep learning frameworks, it is now possible to turn Redis into a reliable runtime for deep learning workloads, providing a simple solution for a model serving microservice. RedisAI is shipped with several cool features such as support for multiple frameworks, CPU and GPU backend, auto batching, DAGing, and soon will be with automatic monitoring abilities. In this talk, we'll explore some of these features of RedisAI and see how easy it is to integrate MLflow and RedisAI to build an efficient productionization pipeline.

Operational challenges behind Serverless architectures

Laurent Bernaille

Ontology2 Platform Evolution

Paul Houle

Google Cloud Dataflow meets TensorFlow

Hayato Yoshikawa

How to make GAE adapt the Great Firewall

Hayato Yoshikawa

Elasticwulf Pycon Talk

Peter Skomoroch

Amazon EC2 may offer the possibility of high performance computing to programmers on a budget. Instead of building and maintaining a permanent Beowulf cluster, we can launch a cluster on-demand using Python and EC2. This talk will cover the basics involved in getting your own cluster running using Python, demonstrate how to run some large parallel computations using Python MPI wrappers, and show some initial results on cluster performance.

Prototyping Data Intensive Apps: TrendingTopics.org

Peter Skomoroch

Pig on spark

Sigmoid

Configure Grafana Chat Bot with GitHub Hubot and SLACK.

Ishan Bhawantha Hewanayake

Ddd lightning talk. dynamo lambda

Joshua Toth

Pig on Spark

mortardata

Developing high frequency indicators using real time tick data on apache supe...

Zekeriya Besiroglu

IBM Open by Design: Graph Technology

Jason Plurad

Análisis del roadmap del Elastic Stack

Elasticsearch

Hw09 Hadoop Applications At Yahoo!Cloudera, Inc.

Presto at Twitter

Bill Graham

Lasta FluteとSaasを使って個人でWebサービスを運営してみた話

Takeshi Kato

Empire: JPA for RDF & SPARQL

Clark & Parsia LLC

用户画像介绍

Leo Feng

What's hot

Migrating PostgreSQL to the Cloud

Mike Fowler

Presto @ Netflix: Interactive Queries at Petabyte Scale

DataWorks Summit

개발자가 알아두면 좋은 5가지 AWS 인공 지능 서비스 깨알 지식 (윤석찬, AWS 테크에반젤리스트) :: AWS DevDay 2018

Amazon Web Services Korea

Deep Learning to Production with MLflow & RedisAI

Databricks

Operational challenges behind Serverless architectures

Laurent Bernaille

Ontology2 Platform Evolution

Paul Houle

Google Cloud Dataflow meets TensorFlow

Hayato Yoshikawa

How to make GAE adapt the Great Firewall

Hayato Yoshikawa

Elasticwulf Pycon Talk

Peter Skomoroch

Prototyping Data Intensive Apps: TrendingTopics.org

Peter Skomoroch

Pig on spark

Sigmoid

Configure Grafana Chat Bot with GitHub Hubot and SLACK.

Ishan Bhawantha Hewanayake

Ddd lightning talk. dynamo lambda

Joshua Toth

Pig on Spark

mortardata

Developing high frequency indicators using real time tick data on apache supe...

Zekeriya Besiroglu

IBM Open by Design: Graph Technology

Jason Plurad

Análisis del roadmap del Elastic Stack

Elasticsearch

Hw09 Hadoop Applications At Yahoo!Cloudera, Inc.

Presto at Twitter

Bill Graham

What's hot (19)

Migrating PostgreSQL to the Cloud

Presto @ Netflix: Interactive Queries at Petabyte Scale

개발자가 알아두면 좋은 5가지 AWS 인공 지능 서비스 깨알 지식 (윤석찬, AWS 테크에반젤리스트) :: AWS DevDay 2018

Deep Learning to Production with MLflow & RedisAI

Operational challenges behind Serverless architectures

Ontology2 Platform Evolution

Google Cloud Dataflow meets TensorFlow

How to make GAE adapt the Great Firewall

Elasticwulf Pycon Talk

Prototyping Data Intensive Apps: TrendingTopics.org

Pig on spark

Configure Grafana Chat Bot with GitHub Hubot and SLACK.

Ddd lightning talk. dynamo lambda

Pig on Spark

Developing high frequency indicators using real time tick data on apache supe...

IBM Open by Design: Graph Technology

Análisis del roadmap del Elastic Stack

Hw09 Hadoop Applications At Yahoo!

Presto at Twitter

Similar to Lasta FluteをGCPにデプロイしてみた

Lasta FluteとSaasを使って個人でWebサービスを運営してみた話

Takeshi Kato

Empire: JPA for RDF & SPARQL

Clark & Parsia LLC

用户画像介绍

Leo Feng

個人でWebサービス with LastaFlute

Takeshi Kato

Insight on "From Hadoop to Spark" by Mark Kerzner

Synerzip

PySparkの勘所（20170630 sapporo db analytics showcase）

Ryuji Tamagawa

Hosting as a Framework

ciconf

A great talk from Tyler Flint: Adopting an app framework like CodeIgniter is like developing at double speed. The framework's conventions and pattern abstractions provide structural simplicity allowing devs to focus on high level functionality. Why should hosting be any different? A hosting framework enables developers to quickly deploy their apps onto powerful infrastructures that can be easily scaled or modified on the fly. I will be presenting a series of real world case studies comparing and contrasting traditional LAMP hosting with flexible framework hosting, sharing some clever configurations that others have used, and also reveal a little of what the future holds for hosting frameworks.

関西DB勉強会 (SAP HANA, express edition)

Koji Shinkubo

Sydney Apache Spark Meetup - Spark Natural Language Processing

Andy Huang

presentationKyle Hamilton

Plack perl superglue for web frameworks and serversTatsuhiko Miyagawa

20171012 found IT #9 PySparkの勘所

Ryuji Tamagawa

Git, GitHub gh-pages and static websites

Csaba Toth

PHP w kolejce, kolejka w PHP - jak wykorzystać moc Apache Kafka

SzymonSadlo

Structured-Streaming-as-a-Service with Kafka, YARN, and Tooling with Jim Dowling

Databricks

Since mid-2016, Spark-as-a-Service has been available to researchers in Sweden from the Rise SICS ICE Data Center at www.hops.site. In this session, Dowling will discuss the challenges in building multi-tenant Spark structured streaming applications on YARN that are metered and easy-to-debug. The platform, called Hopsworks, is in an entirely UI-driven environment built with only open-source software. Learn how they use the ELK stack (Elasticsearch, Logstash and Kibana) for logging and debugging running Spark streaming applications; how they use Grafana and InfluxDB for monitoring Spark streaming applications; and, finally, how Apache Zeppelin can provide interactive visualizations and charts to end-users. This session will also show how Spark applications are run within a ‘project’ on a YARN cluster with the novel property that Spark applications are metered and charged to projects. Projects are securely isolated from each other and include support for project-specific Kafka topics. That is, Kafka topics are protected from access by users that are not members of the project. In addition, hear about the experiences of their users (over 150 users as of early 2017): how they manage their Kafka topics and quotas, patterns for how users share topics between projects, and the novel solutions for helping researchers debug and optimize Spark applications.hear about the experiences of their users (over 150 users as of early 2017): how they manage their Kafka topics and quotas, patterns for how users share topics between projects, and the novel solutions for helping researchers debug and optimize Spark applications.afka topics are protected from access by users that are not members of the project. We will also discuss the experiences of our users (over 150 users as of early 2017): how they manage their Kafka topics and quotas, patterns for how users share topics between projects, and our novel solutions for helping researchers debug and optimize Spark applications.

Cloud State of the Union for Java Developers

Burr Sutter

Apache Sparkにおけるメモリ - アプリケーションを落とさないメモリ設計手法 -

Yoshiyasu SAEKI

Cloud computing overview & running your code on Google Cloud (Jun 2019)

wesley chun

This is a 1-hr tech talk designed for developers to give a comprehensive, vendor-agnostic overview of cloud computing, primarily targeting educators in the higher education market but is open to any developer. This is followed by an introduction to products in Google Cloud, focusing on the serverless products. The talk ends with several inspirational examples of what can be built with Google Cloud.

簡単にレビュー環境が作れる仕組みを作ってる話し

正貴小川

Java-Jersey 到 Python-Flask 服務不中斷重構之旅

Max Lai

Similar to Lasta FluteをGCPにデプロイしてみた (20)

Lasta FluteとSaasを使って個人でWebサービスを運営してみた話

Empire: JPA for RDF & SPARQL

用户画像介绍

個人でWebサービス with LastaFlute

Insight on "From Hadoop to Spark" by Mark Kerzner

PySparkの勘所（20170630 sapporo db analytics showcase）

Hosting as a Framework

関西DB勉強会 (SAP HANA, express edition)

Sydney Apache Spark Meetup - Spark Natural Language Processing

presentation

Plack perl superglue for web frameworks and servers

20171012 found IT #9 PySparkの勘所

Git, GitHub gh-pages and static websites

PHP w kolejce, kolejka w PHP - jak wykorzystać moc Apache Kafka

Structured-Streaming-as-a-Service with Kafka, YARN, and Tooling with Jim Dowling

Cloud State of the Union for Java Developers

Apache Sparkにおけるメモリ - アプリケーションを落とさないメモリ設計手法 -

Cloud computing overview & running your code on Google Cloud (Jun 2019)

簡単にレビュー環境が作れる仕組みを作ってる話し

Java-Jersey 到 Python-Flask 服務不中斷重構之旅

Recently uploaded

A tale of scale & speed: How the US Navy is enabling software delivery from l...

sonjaschweigert1

Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved: - Reduction in onboarding time from 5 weeks to 1 day - Improved developer experience and productivity through actionable findings and reduction of false positives - Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO) Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production. We will cover: - How to remove silos in DevSecOps - How to build efficient development pipeline roles and component templates - How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence) - How to streamline operations with automated policy checks on container images

zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs

Alex Pruden

This paper presents Reef, a system for generating publicly verifiable succinct non-interactive zero-knowledge proofs that a committed document matches or does not match a regular expression. We describe applications such as proving the strength of passwords, the provenance of email despite redactions, the validity of oblivious DNS queries, and the existence of mutations in DNA. Reef supports the Perl Compatible Regular Expression syntax, including wildcards, alternation, ranges, capture groups, Kleene star, negations, and lookarounds. Reef introduces a new type of automata, Skipping Alternating Finite Automata (SAFA), that skips irrelevant parts of a document when producing proofs without undermining soundness, and instantiates SAFA with a lookup argument. Our experimental evaluation confirms that Reef can generate proofs for documents with 32M characters; the proofs are small and cheap to verify (under a second). Paper: https://eprint.iacr.org/2023/1886

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

FIDO Alliance

The Future of Platform Engineering

Jemma Hussein Allen

Securing your Kubernetes cluster_ a step-by-step guide to success !

KatiaHIMEUR1

Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster. However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks. In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.

Climate Impact of Software Testing at Nordic Testing Days

Kari Kakkonen

My slides at Nordic Testing Days 6.6.2024 Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

Prayukth K V

The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development. The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers: State of global ICS asset and network exposure Sectoral targets and attacks as well as the cost of ransom Global APT activity, AI usage, actor and tactic profiles, and implications Rise in volumes of AI-powered cyberattacks Major cyber events in 2024 Malware and malicious payload trends Cyberattack types and targets Vulnerability exploit attempts on CVEs Attacks on counties – USA Expansion of bot farms – how, where, and why In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East Why are attacks on smart factories rising? Cyber risk predictions Axis of attacks – Europe Systemic attacks in the Middle East Download the full report from here: https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/

Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx

nkrafacyberclub

Enhancing Performance with Globus and the Science DMZ

Globus

Assure Contact Center Experiences for Your Customers With ThousandEyes

ThousandEyes

SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf

Peter Spielvogel

Building better applications for business users with SAP Fiori. • What is SAP Fiori and why it matters to you • How a better user experience drives measurable business benefits • How to get started with SAP Fiori today • How SAP Fiori elements accelerates application development • How SAP Build Code includes SAP Fiori tools and other generative artificial intelligence capabilities • How SAP Fiori paves the way for using AI in SAP apps

Quantum Computing: Current Landscape and the Future Role of APIs

Vlad Stirbu

Accelerate your Kubernetes clusters with Varnish Caching

Thijs Feryn

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

James Anderson

Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management. The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM). Speakers: Bob Boule Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle. Gopinath Rebala Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.

FIDO Alliance Osaka Seminar: Overview.pdf

FIDO Alliance

GraphRAG is All You need? LLM & Knowledge Graph

Guy Korland

Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs. 1. Unifying Large Language Models and Knowledge Graphs: A Roadmap. https://arxiv.org/abs/2306.08302 2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs: https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/

PHP Frameworks: I want to break free (IPC Berlin 2024)

Ralf Eggert

In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development. This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

FIDO Alliance

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

BookNet Canada

The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more. Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/ Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.

Monitoring Java Application Security with JDK Tools and JFR Events

Ana-Maria Mihalceanu