Now a days, thousands of database are supporting many kind of Rakuten's services. and it is hard to manage many databases well. especially, backup and restore.
so, we are progressing new backup system for our databases.
I am going to share some know-hows and experiences that have been acquired with you
[db tech showcase Tokyo 2016] D24: データベース環境における検証結果から理解する失敗しないフラッシュ活用法 第三章 ~デ...Insight Technology, Inc.
フラッシュのGB単価はHDDと並び、オールフラッシュ導入が加速化する一方、インラインでの重複排除、圧縮機能のオーバーヘッド、メンテナンス / 障害時の影響など、気をつけなければいけない事は沢山あります。本セッションでは、オールフラッシュ製品(Pure Storage)上でOracle Databaseを稼働させた検証結果と生のデモンストレーションをベースに、DB on Pure Storageならではの活用法を考えます。
[db tech showcase Tokyo 2016] D24: データベース環境における検証結果から理解する失敗しないフラッシュ活用法 第三章 ~デ...Insight Technology, Inc.
フラッシュのGB単価はHDDと並び、オールフラッシュ導入が加速化する一方、インラインでの重複排除、圧縮機能のオーバーヘッド、メンテナンス / 障害時の影響など、気をつけなければいけない事は沢山あります。本セッションでは、オールフラッシュ製品(Pure Storage)上でOracle Databaseを稼働させた検証結果と生のデモンストレーションをベースに、DB on Pure Storageならではの活用法を考えます。
[db tech showcase Tokyo 2016] D32: SPARCサーバ + Pure Storage DB仮想化のすべらない話 〜 Exa...Insight Technology, Inc.
NTTぷらら様は、「柔軟に増減設できるDB基盤」と「コスト最適化」をキーワードに、DB仮想化をSPARCサーバ + Pure Storageの組み合わせで実現しました。更に現在、理想のDB基盤を実現するために、Exadata環境のリプレースも進めています。本セッションでは、検証結果や生のデモンストレーションに、スライドには書けない生々しい話を加え、理想のDB環境実現までの道のりをご紹介します。
Design Sprints are the best way we know of to help teams build the right thing – a product that customers will love. But more than that, Design Sprints are a way to be sure that everyone on a team has a voice and can influence the team’s decisions. Too often, teams do not hear from those who are new or different or who do not agree with the rest of the team – and then the team loses the value of its diversity. Design Sprints help teams consider the ideas of everyone and come up with great solutions to tough problems in a very short time.
https://tech.rakuten.co.jp/
[db tech showcase Tokyo 2016] D32: SPARCサーバ + Pure Storage DB仮想化のすべらない話 〜 Exa...Insight Technology, Inc.
NTTぷらら様は、「柔軟に増減設できるDB基盤」と「コスト最適化」をキーワードに、DB仮想化をSPARCサーバ + Pure Storageの組み合わせで実現しました。更に現在、理想のDB基盤を実現するために、Exadata環境のリプレースも進めています。本セッションでは、検証結果や生のデモンストレーションに、スライドには書けない生々しい話を加え、理想のDB環境実現までの道のりをご紹介します。
Design Sprints are the best way we know of to help teams build the right thing – a product that customers will love. But more than that, Design Sprints are a way to be sure that everyone on a team has a voice and can influence the team’s decisions. Too often, teams do not hear from those who are new or different or who do not agree with the rest of the team – and then the team loses the value of its diversity. Design Sprints help teams consider the ideas of everyone and come up with great solutions to tough problems in a very short time.
https://tech.rakuten.co.jp/
Ecommerce websites today have become massive marketplaces of several hundred million products. Rakuten Ichiba alone hosts more than 300 million products. Such large marketplaces present numerous challenges in organizing all the product information so that customers are able to find products in an efficient manner. In this talk, I will describe how large-scale machine learning is helping us to organize and search this vast collection of information.
Specifically, I will talk about two of our projects in product categorization and search relevance. Product categorization refers to the task of organizing product information into appropriate genres of a taxonomy, and a good product categorization helps customers navigate a website correctly and find products efficiently. Additionally, I will briefly talk about our work on search relevance that uses feedback based on customer clicks to improve search algorithm in an ongoing manner.
https://tech.rakuten.co.jp/
Mindfulness ― one of the fundamental teachings by the Buddha, has being highly valued practice for the last 2,500 years in many Asian countries such as Myanmar, Sri Lanka, Thailand, India, Japan, Korea and China. As historical records shows, mindfulness has helped many people to live a meaningful life in this region. Finally, the advancements of technology such as fMRI machines, EEG studies and empirical studies have enable scientists to show the effectiveness of mindfulness meditation for the human wellbeing as a scientific fact. This scientific knowledge has made mindfulness accessible for millions of people through out the world and made available for a broader audience as a secular tool for improving human wellbeing. Therefore, mindfulness has being actively promoted in various places such as schools, governments and workplaces.
In this talk we will introduce mindfulness and the scientific research made it popular among a wider audience. Further, we will introduce Rakuten Mindfulness Clubs activities and briefly touch upon the potential application to Human Computer Interaction.
https://tech.rakuten.co.jp/
Overview of GraphQL
How it is different from REST
When you should consider using it and when you should not
Incremental demos until calling GraphQL from an React application: https://github.com/bary822/graphQL-techtalk
How can you and your team adopt DevOps? Is it as simple as taking the blue or the red pill? During this session we will share how we changed the culture within Microsoft Corp., what were the challenged faced and how we have addressed them. Transparency and continuous learning are just few of the examples that we will leverage to illustrate this transformation. We will discuss what it means to be a manager in the DevOps area, how to get there with some concreate examples.
https://tech.rakuten.co.jp/
Creating delightful digital user experiences is an ever-evolving craft which must take into account the latest technology, trends and mindsets. But despite all the new tech and evolving interactions, how do we retain the core human element in a fast-changing digital world?
https://tech.rakuten.co.jp/
This session will explain about new experience of PlayStation VR touching on history of development, product detail and potential in future.
https://tech.rakuten.co.jp/
●Overall introduction of Ichiba
Introduction
●Redis Cluster in Rakuten Ichiba
How we use Redis Cluster in Rakuten Ichiba
●R Framework
The challenge of updating a legacy system sharing code between multiple teams, using an in-house developed library for the Rakuten Ichiba Frontend side.
●Rakuten Catalog Platform- Classification Approach for 280,000,000 Ichiba items -
1. Taxonomy Strategy(Analyze, Adoption)
2. Rakuten Catalog Platform Classification Ichiba Item data -> Taxonomy(Taxonomy(Genre/Tag/Attribute) management/development) -> Catalog(Product Master) -> Data governance system -> Data Processing Unit -> Auto classification(Item information/Image)
●How to reconstruct a million-user app
Describes why we decided to rewrite our app, what difficulties we faced and how we create the new structure to ensure it's flexible, stable and maintainable.
https://tech.rakuten.co.jp/
There are many vision sensors such as high-speed camera, IR camera, depth camera, gaze tracker, and action camera. They are getting smaller, lighter, and less expensive. These vision sensors are imporntat because they can see what human cannot. By using such invisible information effectively, it becomes possible to develop natural, intuitive, and innovative HCI. In this talk, I would like to show some of our researches that uses advanced vision sensors, including LCD tabletop, interactive surface on the water, gaze navigation using unaware blur, dynamic projection mapping, and BallCam.
https://tech.rakuten.co.jp/
Today the Java EE is a de-facto standard architecture for any kind of enterprise systems in the world, and realized as ease of development on its specification. But especially for the huge enterprise systems, not small or mediocre, there are still many issue for designing, developing, and operating. You can learn the overview and some details of the huge enterprise system design, with referring latest Java EE specifications on this session.
https://tech.rakuten.co.jp/
IBM Watson Question-Answering System and Cognitive ComputingRakuten Group, Inc.
IBM's vision of cognitive computing has been steadily embraced across the industries since IBM's Watson question-answering system made a sensational debut at the US Jeopardy! television quiz show in 2011. As a core member of the Watson project, I would like to share the excitement of the project and the last five and a half year of its progress into the cognitive business. In this talk, I will also give a technical overview of Watson, major use cases, and perspectives on the future of cognitive computing.
https://tech.rakuten.co.jp/
Session to introduce Rakuten Drone project, and to explain Rakuten’s approach towards emerging Drone technology.
The session will cover both general information about drone industry like regulation issues, and more detail information about
our new technology behind Sora Raku service, which was held at Camel Golf Course held in May
https://tech.rakuten.co.jp/
NVIDIA compute GPUs and software toolkits are key drivers behind major advancements in machine learning. Of particular interest is a technique called "deep learning", which utilizes what are known as Convolution Neural Networks (CNNs) having landslide success in computer vision and widespread adoption in a variety of fields such as autonomous vehicles, cyber security, and healthcare. In this talk is presented a high level introduction to deep learning where we discuss core concepts, success stories, and relevant use cases. Additionally, we will provide an overview of essential frameworks and workflows for deep learning. Finally, we explore emerging domains for GPU computing such as large-scale graph analytics, in-memory databases.
https://tech.rakuten.co.jp/
Web App for Containers + MySQLでコンテナ対応したPHPアプリを作ろう! Yoichi Kawasaki
Web App for Containers は、アプリスタックのホストに Docker コンテナーを使用するため皆さんが今Linux上で利用しているOSSベースのアプリもアプリスタックごとDockerコンテナ化することでそのまま Web App for Containersで利用することができます。本ウェビナーでは簡単なMySQL + PHPアプリ(Wordpress)を題材に、アプリをコンテナ化し Web App for Containersにデプロイするまでの一連の流れを解説し、CIツールを使った継続的なデプロイ方法についてご紹介します。今回、AzureのフルマネージドMySQLサービスであるAzure DB for MySQLを利用して完全マネージドな環境でのアプリ実行を実現します。
M20_Azure SQL Database 最新アップデートをまとめてキャッチアップ [Microsoft Japan Digital Days]日本マイクロソフト株式会社
Microsoft MVP for Data Platform
小澤 真之 氏
本セッションでは、SQL Server ベースの PaaS である、Azure SQL Database の直近で発表されているアップデートをまとめてご紹介させていただきます。
Azure SQL Database は進化を続けており、新しい機能も次々と追加されています。この機会にぜひ、最新の情報をお持ち帰りください。
【Microsoft Japan Digital Daysについて】
Microsoft Japan Digital Days は、お客様が競争力を高め、市場の変化に迅速に対応し、より多くのことを達成することを目的とした、日本マイクロソフトがお届けする最大級のデジタル イベントです。4 日間にわたる本イベントでは、一人一人の生産性や想像力を高め、クラウド時代の組織をデザインするモダンワークの最新事例や、変化の波をうまく乗り切り、企業の持続的な発展に必要なビジネスレジリエンス経営を支えるテクノロジの最新機能および、企業の競争優位性に欠かせないクラウド戦略のビジョンなどデジタル時代に必要な情報をお届けいたしました。(2021年10月11日~14日開催)
In my presentation, I will summarize the applied and practical aspects of creating sustainable software products. What does it mean - "green" software for users and developers? I want to explain how creating “green” software can be driven by multiple organizational layers. And how building “green” software products can help the organization increase overall software product efficiency.
This presentation introduces the OWASP Top 10:2021.
It explains how to look at the data related to OWASP Top 10:2021, and provides detailed explanations of items with distinctive data. It also introduces the OWASP Project related to each item.
4. 4
Who am I?
2008 ~ 2010, 名古屋大学情報科学研究科、修士卒業
2010 ~, 新卒で楽天入社
MySQL DB Engineer
DB Application, DB platform 設計、開発、構築
Python , Ruby, Java, Shell-script, Coffee-script等でプログラミング
~ 2008, 韓国で大学まで
??
5. 5
History in Rakuten (~2014年)
権限付与、スキーマ変更等
スキーマ & SQL review, DB構築, migration
DB consulting, Online-schema 導入,
bench-mark with YCSB & TPCC, 自動化script
Monitoring design (Almond) / development
12. 12
My Strategy
Monitoring Design / Development ( ~ 2014年)
Backup Design / Development
Deploy, Alert Design / Development
DBaaS / DB Platform
Other DBs (No-SQL, and so on)
14. 14
The History Of Database Structure & Backup
Age DB Structure Backup Structure
VCS VCS + Replication
VCS + Shard
SAN Snapshot
IA + SSD IA Server + SSD LVM
CLOUD Private Cloud Veeam
SAN
VIP
VIP
Active Standby Active Standby Backup
VCS IA + SSD
15. 15
The Features Of Current Backup
重複排除により効率的なbackup
backup sizeを節約できるので、ストレージ容量を削減できる
Jobの実行サーバと管理用のサーバが独立している
負荷分散ができる
SnapShotでのbackup
59. 59
Future
Monitoring Design / Development ( ~ 2014年)
Backup Design / Development
Deploy, Alert Design / Development
DBaaS / DB Platform
Other DBs (No-SQL, and so on)