Awesome List Updates on Apr 10, 2019

9 awesome lists updated today.

🏠 Home · 🔍 Search · 🔥 Feed · 📮 Subscribe · ❤️ Sponsor

1. Awesome Streaming

Table of Contents / Streaming Engine

• Apache Apex (⭐349) [Java] - unified platform for big data stream and batch processing.

• Apache Flink (⭐25k) [Java] - system for high-throughput, low-latency data stream processing that supports stateful computation, data-driven windowing semantics and iterative stream processing.

• Apache Samza (⭐828) [Scala/Java] - distributed stream processing framework that build on Kafka(messaging, storage) and YARN(fault tolerance, processor isolation, security and resource management).

• Apache Spark Streaming (⭐41k) [Scala] - makes it easy to build scalable fault-tolerant streaming applications.

• AthenaX (⭐1.2k) [Java] - Uber's Stream Analytics Framework used in production

• Faust (⭐6.8k) [Python] - stream processing library, porting the ideas from Kafka Streams to Python

• Hazelcast Jet (⭐1.1k) [Java] - A general purpose distributed data processing engine, built on top of Hazelcast.

• hailstorm (⭐91) [Haskell] - distributed stream processing with exactly-once semantics based on Storm.

• mupd8(muppet) (⭐127) [Scala/Java] - mapReduce-style framework for processing fast/streaming data.

• Onyx (⭐2k) [Clojure] - Distributed, masterless, high performance, fault tolerant data processing.

• s4 (⭐43) [Java] - general-purpose, distributed, scalable, fault-tolerant, pluggable platform that allows programmers to easily develop applications for processing continuous unbounded streams of data.

• SABER (⭐39) [Java/C] - Window-Based Hybrid CPU/GPU Stream Processing Engine.

• SPQR (⭐30) [Java] - dynamic framework for processing high volumn data streams through pipelines.

• tigon (⭐286) [C++/Java] - high throughput real-time streaming processing framework built on Hadoop and HBase.

• Teknek (⭐9) [Java] - Simple elegant stream processing with interactive prototying shell SOL (Stream Operator Language) Mesos, designed for high performance data processing jobs that require flexibility & control.

Table of Contents / Streaming Library

• Apache Kafka Streams (⭐30k) [Java] - lightweight stream processing library included in Apache Kafka (since 0.10 version).

• Benthos (⭐8.4k) [Go] - Benthos is a high performance and resilient message streaming service, able to connect various sources and sinks and perform arbitrary actions, transformations and filters on payloads

• FS2(prev. 'Scalaz-Stream') (⭐2.4k) [Scala] - Compositional, streaming I/O library for Scala.

• monix (⭐1.9k) [Scala] - high-performance Scala / Scala.js library for composing asynchronous and event-based programs.

• Streamline (⭐164) [Java] - Stream Analytics Framework by Hortonworks, designed as a wrapper around existing streaming solutions like Storm. Aimed to allow users to drag-and-drop streaming components to focus on business logic.

• StreamAlert (⭐2.9k) [Python] - Airbnb's Real-time Data Analysis and Alerting.

• Swave (⭐172) [Scala] - A lightweight Reactive Streams Infrastructure Toolkit for Scala.

Table of Contents / Streaming Application

• straw (⭐102) [Python/Java] - A platform for real-time streaming search.

• storm-crawler (⭐921) [Java] - Web crawler SDK based on Apache Storm.

Table of Contents / IoT

• sensorbee (⭐231) [Go] - lightweight stream processing engine for IoT.

• Apache Edgent (⭐216) [Java] - a programming model and runtime that enables continuous streaming analytics on gateways and edge devices which can work with centralized systems to provide efficient and timely analytics across the whole IoT ecosystem: from the center to the edge, opens sourced by IBM.

Table of Contents / DSL

• coast (⭐60) [Scala] - a DSL that builds DAGs on top of Samza and provides exactly-once semantics.

• Esper (⭐859) [Java] - component for complex event processing (CEP) and event series analysis.

• Streamparse (⭐1.5k) [Python] - lets you run Python code against real-time streams of data via Apache Storm.

• summingbird (⭐2.1k) [Scala] - library that lets you write MapReduce programs that look like native Scala or Java collection transformations and execute them on a number of well-known distributed MapReduce platforms, including Storm and Scalding.

Table of Contents / Data Pipeline

• Apache Kafka (⭐30k) [Scala/Java] - distributed, partitioned, replicated commit log service, which provides the functionality of a messaging system, but with a unique design.

• Apache Pulsar (⭐15k) [Java] - distributed pub-sub messaging platform with a very flexible messaging model and an intuitive client API.

• camus (⭐883) [Java] - Linkedin's Kafka -> HDFS pipeline.

• databus (⭐3.7k) [Java] - Linkedin's source-agnostic distributed change data capture system.

• flume (⭐2.6k) [Java] - distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data.

• metaq (⭐1.3k) [Java] - Taobao's high available, high performance distributed messaging system

• NATS streaming (⭐2.5k) [Go] - fast disk-backed messaging solution

• nsq (⭐25k) [Go] - realtime distributed messaging platform designed to operate at scale, handling billions of messages per day.

• suro (⭐797) [Java] - data pipeline service for collecting, aggregating, and dispatching large volume of application events including log data.

Table of Contents / Online Machine Learning

• Apache Samoa (⭐249) [Java] - distributed streaming machine learning (ML) framework that contains a programing abstraction for distributed streaming ML algorithms.

• DataSketches (⭐914) [Java] - sketches library from Yahoo!.

• StreamingBandit (⭐80) [Python] - Provides a webserver to quickly setup and evaluate possible solutions to contextual multi-armed bandit (cMAB) problems.

Table of Contents / Streaming SQL

• pipelinedb (⭐2.6k) [C] - An open-source relational database that runs SQL queries continuously on streams, incrementally storing results in tables.

• squall (⭐271) [Java] - Squall executes SQL queries on top of Storm for doing online processing.

Table of Contents / Benchmark

• storm-perf-test (⭐74) [Java] - a simple storm performance/stress test.

• streaming-benchmarks (⭐640) [Java] - Benchmarks for Low Latency (Streaming) solutions including Apache Storm, Apache Spark, Apache Flink, etc.

• flotilla (⭐236) [Go] - Automated message queue orchestration for scaled-up benchmarking.

Table of Contents / Toolkit

• akka (⭐13k) [Scala] - toolkit and runtime for building highly concurrent, distributed, and resilient message-driven application on the JVM.

• pulsar (⭐1.9k) [Python] - Actor based event driven concurrent framework for Python.

• aeron (⭐7.8k) [Java/C++] - efficient reliable unicast and multicast message transport.

• StreamFlow (⭐254) [Java] - stream processing tool designed to help build and monitor processing workflows.

• samza-luwak (⭐99) [Java] - uses Luwak, a stored-query engine built on Lucene, to implement full-text search on streams.

• Turbine (⭐833) [Java] - tool for aggregating streams of Server-Sent Event (SSE) JSON data into a single stream.

2. Awesome Ros2

Packages / Application layer

• ros2_pytorch (⭐40) - ROS2 nodes for computer vision tasks in PyTorch .

Packages / Driver layer

• ros2_track_imu (⭐5) - ROS2 node for TrackIMU IMU sensor.

3. Mind Expanding Books

Fiction / Science Fiction

• Name: The Martian

  Author: Andy Weir

  Goodreads Rating: 4.40

  Year Published: 2012

• Name: The Hitchhiker's Guide to the Galaxy

  Author: Douglas Adams

  Goodreads Rating: 4.38

  Year Published: 1979

4. Awesome Aws

Open Source Repos / Lambda

• goadapp/goad 🔥🔥🔥🔥 (⭐1.9k) - Lambda powered, highly distributed, load testing tool.

Open Source Repos / DevOps

• cloud-custodian/cloud-custodian 🔥🔥🔥🔥🔥 (⭐5.7k) - Rules engine for management, DSL in yaml for query, filter, and actions on resources.

5. Awesome Interview Questions

Programming Languages/Frameworks/Platforms / Sass

• Top 10 Sass Interview Questions from educba

6. Awesome Fonts

Free fonts / Collections

• USWDS - U.S. Web Design System
  • Public Sans

7. Awesome Cross Platform Nodejs

Libraries / Signals

• fkill (⭐739) - Kill processes. Cross-platform.

8. Awesome Swift

Utility / Barcode

• Codextended (⭐1.5k) - Extensions giving Codable API type inference super powers.

9. Awesome Stacks

Serverless Stack with React on AWS ↗ / Resources

• Create React App - 🛠 - 🐙 (⭐103k) - Set up a modern web app by running one command.

Rails Monitoring Stack ↗ / Resources

• rack-mini-profiler (⭐3.8k) - 🐙 (⭐3.8k) - Profiler for your development and production Ruby rack apps.

• Prev: Apr 11, 2019
• Next: Apr 09, 2019