Apache Spark Streaming + Kafka 0.10 with Joan ViladrosarieraSpark Summit
Spark Streaming has supported Kafka since it’s inception, but a lot has changed since those times, both in Spark and Kafka sides, to make this integration more fault-tolerant and reliable.Apache Kafka 0.10 (actually since 0.9) introduced the new Consumer API, built on top of a new group coordination protocol provided by Kafka itself. So a new Spark Streaming integration comes to the playground, with a similar design to the 0.8 Direct DStream approach. However, there are notable differences in usage, and many exciting new features. In this talk, we will cover what are the main differences between this new integration and the previous one (for Kafka 0.8), and why Direct DStreams have replaced Receivers for good. We will also see how to achieve different semantics (at least one, at most one, exactly once) with code examples. Finally, we will briefly introduce the usage of this integration in Billy Mobile to ingest and process the continuous stream of events from our AdNetwork.
Operations: Production Readiness Review – How to stop bad things from HappeningAmazon Web Services
There is more to deploying code than pushing the deploy button. A good practice that many companies follow is a Production Readiness Review (PRR) which is essentially a pre-flight check list before a service launches. This helps ensure new services are properly architected, monitored, secured, and more. We’ll walk through an example PRR and discuss the value of ensuring each of these is properly taken care of before your service launches.
by Joyjeet Banerjee, Enterprise Solutions Architect, AWS
Amazon Aurora is a MySQL- and PostgreSQL-compatible database engine that combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open source databases. In this deep dive session, we’ll discuss best practices and explore new features in areas like high availability, security, performance management and database cloning. Level 300
This is a deck of .NET Fringe Japan 2018 New Year's Party short talk. It describes some tips of implementations of Microsoft.Extensions.Logging structured logging and Application Insights .NET.
Go Conference Tokyo 2019 Autumn
https://gocon.jp/sessions/microsoft_graph_api_library_for_go/
msgraph.go demo - SharePoint Online + Microsoft Flow + GitLab CI
https://www.youtube.com/watch?v=DwKk405XyF4
msgraph.go
https://github.com/yaegashi/msgraph.go
セル生産方式におけるロボットの活用には様々な問題があるが,その一つとして 3 体以上の物体の組み立てが挙げられる.一般に,複数物体を同時に組み立てる際は,対象の部品をそれぞれロボットアームまたは治具でそれぞれ独立に保持することで組み立てを遂行すると考えられる.ただし,この方法ではロボットアームや治具を部品数と同じ数だけ必要とし,部品数が多いほどコスト面や設置スペースの関係で無駄が多くなる.この課題に対して音𣷓らは組み立て対象物に働く接触力等の解析により,治具等で固定されていない対象物が組み立て作業中に運動しにくい状態となる条件を求めた.すなわち,環境中の非把持対象物のロバスト性を考慮して,組み立て作業条件を検討している.本研究ではこの方策に基づいて,複数物体の組み立て作業を単腕マニピュレータで実行することを目的とする.このとき,対象物のロバスト性を考慮することで,仮組状態の複数物体を同時に扱う手法を提案する.作業対象としてパイプジョイントの組み立てを挙げ,簡易な道具を用いることで単腕マニピュレータで複数物体を同時に把持できることを示す.さらに,作業成功率の向上のために RGB-D カメラを用いた物体の位置検出に基づくロボット制御及び動作計画を実装する.
This paper discusses assembly operations using a single manipulator and a parallel gripper to simultaneously
grasp multiple objects and hold the group of temporarily assembled objects. Multiple robots and jigs generally operate
assembly tasks by constraining the target objects mechanically or geometrically to prevent them from moving. It is
necessary to analyze the physical interaction between the objects for such constraints to achieve the tasks with a single
gripper. In this paper, we focus on assembling pipe joints as an example and discuss constraining the motion of the
objects. Our demonstration shows that a simple tool can facilitate holding multiple objects with a single gripper.
【DLゼミ】XFeat: Accelerated Features for Lightweight Image Matchingharmonylab
公開URL:https://arxiv.org/pdf/2404.19174
出典:Guilherme Potje, Felipe Cadar, Andre Araujo, Renato Martins, Erickson R. ascimento: XFeat: Accelerated Features for Lightweight Image Matching, Proceedings of the 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2023)
概要:リソース効率に優れた特徴点マッチングのための軽量なアーキテクチャ「XFeat(Accelerated Features)」を提案します。手法は、局所的な特徴点の検出、抽出、マッチングのための畳み込みニューラルネットワークの基本的な設計を再検討します。特に、リソースが限られたデバイス向けに迅速かつ堅牢なアルゴリズムが必要とされるため、解像度を可能な限り高く保ちながら、ネットワークのチャネル数を制限します。さらに、スパース下でのマッチングを選択できる設計となっており、ナビゲーションやARなどのアプリケーションに適しています。XFeatは、高速かつ同等以上の精度を実現し、一般的なラップトップのCPU上でリアルタイムで動作します。
9. 1通のメールが発端
Fabian Reinartz
ドイツ ベルリン
2016/04- CoreOS
2015/09-2016/03 SoundCloud/Prometheus
2017年08月10日
To: Prometheus Developers Group
Instead I just want to serve Brian's request to discuss our logging
library usage.
Triggered was this by me using Go kit's logging package in
prometheus/tsdb rather than our so far canonical
prometheus/common/log package.
Prometheusで使用するロギングライブラリについて議論したい。
tsdbではGo kitを使用してたよね。
39. glg https://github.com/kpango/glg glg is simple and fast leveled logging library for Go.
glog https://github.com/golang/glog Leveled execution logs for Go.
go-cronowriter https://github.com/utahta/go-cronowriter Simple writer that rotate log files automatically based on current date and time, like cronolog.
go-log https://github.com/siddontang/go-log Log lib supports level and multi handlers.
go-log https://github.com/ian-kent/go-log Log4j implementation in Go.
go-logger https://github.com/apsdehal/go-logger Simple logger of Go Programs, with level handlers.
gologger https://github.com/sadlil/gologger Simple easy to use log lib for go, logs in Colored Console, Simple Console, File or Elasticsearch.
gomol https://github.com/aphistic/gomol Multiple-output, structured logging for Go with extensible logging outputs.
gone/log https://github.com/One-com/gone/tree/master/log Fast, extendable, full-featured, std-lib source compatible log library.
log https://github.com/apex/log Structured logging package for Go.
log https://github.com/go-playground/log Simple, configurable and scalable Structured Logging for Go.
log-voyage https://github.com/firstrow/logvoyage Full-featured logging saas written in golang.
log15 https://github.com/inconshreveable/log15 Simple, powerful logging for Go.
logdump https://github.com/ewwwwwqm/logdump Package for multi-level logging.
logex https://github.com/chzyer/logex Golang log lib, supports tracking and level, wrap by standard log lib.
logger https://github.com/azer/logger Minimalistic logging library for Go.
logo https://github.com/mbndr/logo Golang logger to different configurable writers.
logrus https://github.com/Sirupsen/logrus Structured logger for Go.
logrusly https://github.com/sebest/logrusly logrus plug-in to send errors to a Loggly
logutils https://github.com/hashicorp/logutils Utilities for slightly better logging in Go (Golang) extending the standard logger.
logxi https://github.com/mgutz/logxi 12-factor app logger that is fast and makes you happy.
lumberjack https://github.com/natefinch/lumberjack Simple rolling logger, implements io.WriteCloser.
mlog https://github.com/jbrodriguez/mlog Simple logging module for go, with 5 levels, an optional rotating logfile feature and stdout/stderr output.
ozzo-log https://github.com/go-ozzo/ozzo-log
High performance logging supporting log severity, categorization, and filtering. Can send filtered log
messages to various targets (e.g. console, network, mail).
seelog https://github.com/cihub/seelog Logging functionality with flexible dispatching, filtering, and formatting.
slf https://github.com/ventu-io/slf The Structured Logging Facade (SLF) for Go (like SLF4J but structured and for Go).
slog https://github.com/ventu-io/slog The reference implementation of the Structured Logging Facade (SLF) for Go.
spew https://github.com/davecgh/go-spew Implements a deep pretty printer for Go data structures to aid in debugging.
stdlog https://github.com/alexcesaro/log Stdlog is an object-oriented library providing leveled logging. It is very useful for cron jobs.
tail https://github.com/hpcloud/tail Go package striving to emulate the features of the BSD tail program.
xlog https://github.com/xfxdev/xlog Plugin architecture and flexible log system for Go, with level ctrl, multiple log target and custom log format.
xlog https://github.com/rs/xlog Structured logger for `net/context` aware HTTP handlers with flexible dispatching.
参考:awesome-goのLoggingより34種類