Data Stream Processing
Elasticity and resource aware scheduling in distributed data stream processing systems
... There has been existing work done on metric design to capture congestion and measure throughput in data stream processing systems. An existing work [28] proposed the use of metrics such as the ...
81
Stela: on-demand elasticity in distributed data stream processing systems
... distributed data stream processing ...distributed stream processing systems such as Storm [27], Samza [36], Heron [28], Spark Streaming [23] [37], MillWheel [47] do not currently ...
59
Sensors Data-Stream Processing Middleware based on Multi-Agent Model
... sensor data-stream we solve the complexity ...sensor data-stream our middleware use Simple Sensor Agent (SSA) ...sensor data-stream ...received data-stream and to ...
14
VStorm: Video Traffic Management By Distributed Data Stream Processing Systems
... distributed stream processing ...of data streams and computation in a massive ...distributed data stream processing (DSP) systems in a large-scale mul- timedia network with ...
7
Data Stream Processing on Enterprise Integration Platforms
... Due to the fact that DSMSs tend to have their own dedicated data models and operators, it is difficult to enable existing heterogeneous systems to work together. A class of technologies that can be helpful in this ...
56
Strategy for Data Stream Processing Based on Measurement Metadata: An Outpatient Monitoring Scenario
... for Data Stream Processing based on Measurement Meta- data, applied to an outpatient monitoring ...heterogeneous data sources as data streams, together with metadata associated ...
13
A Survey on Big Data Stream Processing Technological
... a data stream processing technological in the big data ...behind data streams processing ...Big Data Processing with Apache Spark,Apache Flink and so ...big ...
5
Big Data, Stream Processing & Algorithms
... Summary • Apache Software Foundation is attracting more and more big data projects • The computation is moving from batch processing to a hybrid model • Yarn and Mesos are solidifying th[r] ...
48
Scalable linked data stream processing via network-aware workload scheduling
... of Data Partitioning The results above are very ...the data came partitioned into meaningful ...station, data about one stock usually arrives from one source, ...the data might be mixed (even ...
17
Comparative Analysis of Big Data Stream Processing Systems
... same data at each processing step such as machine learn- ing and graph processing ...stores data on hard drives and reloads the same data directly from hard drives on each ...avoids ...
88
Patterns for distributed real-time stream processing
... big data applications aimed at stream processing, one of the multiple difficulties in their development is the lack of a general catalog of computational patterns relating the differences in cost of ...
16
Big provenance stream processing for data-intensive computations
... the Data Lake are streamed into the provenance subsystem where they are processed, stored and ...Provenance Stream Processing and Storage component at the heart of this architecture accepts the ...
134
Defining the execution semantics of stream processing engines
... of data on the fly, as soon as they become avail- able, is a fundamental requirement in today’s information ...distributed stream processing engines (SPEs) address this requirement and provide ...
24
RDF Stream Processing: Let's React
... stored data, using asynchronous messaging) from end-to-end in an RSP is key to achieve ...prevent data bottlenecks and overflow. Also, by handling stream delays, data out of or- der and ...
10
Online network intrusion detection system using temporal logic and stream data processing
... of data arriving in rapid, time-varying and continuous ...the data (continuous ...arrived data is maintained, meaning that old data must be removed as time goes ...infinite stream and ...
212
Adaptive Provisioning of Stream Processing Systems in the Cloud
... batch processing models such as map/reduce [4]. The real-time nature of stream processing poses unique challenges due to the need to achieve low latency and guaranteed ...balances stream ...
6
I Logs. Apache Kafka, Stream Processing, and Real-time Data Jay Kreps
... Log-centric Architecture Key-Value Query Layer Search Query Layer Stream Proces sing Log Hadoop Monitoring & Graphs Graph DB, OLAP Store, Etc.[r] ...
42
Performance Analysis of Cloud-Based Stream Processing Pipelines for Real-Time Vehicle Data
... that processing 400 records take more time compared with processing 200 ...volume data streaming with a large amount of throughput, if it is worth trading latency with throughput is an- other hard ...
62
Stream Processing Systems Benchmark: StreamBench
... of stream pro- cessing systems comprehensively, even the steps of benchmark flow attempt to probe common operations performed on data ...these stream processing ...emitted data events ...
66
Balancing Load in Stream Processing with the Cloud
... event processing system for handling complex streaming ...scales stream processing by partitioning queries over n machines using row/column scaling ...a stream processing system, the ...
6