[PDF] Top 20 Performance Analysis of Data Filtering in Scientific Workflows

... of data involved in data-intensive experiments, this filtering becomes difficult to be planned a priori, since it is defined based on runtime analysis of partial ...produced data, which ... See full document

... numerous scientific fields such as knowledge discovery, bioinformatics, computations, weather and climate modeling, earthquake science, genome analysis and astronomy can be broken down into smaller tasks ... See full document

... in workflows). They can be categorized in two groups of scientific workflows and business workflows and executed in different implementa- tion styles depended on the process context, ...While ... See full document

... Although scientific workflows will contribute to all science fields by their feasible characteristics, provenance management should be a concern too in order to have an understanding of how the results are ... See full document

... of scientific and engineering activities, including data acquisition, data analysis and report ...commercial data analysis tools and highly specialized data acquisition ... See full document

... “Scientific research is exploratory in nature. Scientists carry out experiments, often in a trial and error manner, wherein they modify the steps of the task to be performed as the experiment proceeds. As ... See full document

... Scientific workflows are typically used to automate the processing, analysis and management of scientific ...Most scientific workflow programs provide a user-friendly graphical user ... See full document

... network-based scientific problem-solving environments. The advent of high-performance computing engines and networks is opening a fantastic opportunity for bringing serious numerical and problem-solving ... See full document

... vast data collections are processed in scientific workflows, new risks and challenges are ...and scientific workflows. To address specific concerns with data management in these ... See full document

... exchange data and information at both the network level and the web interface ...In scientific community, rapid advancement in both large-scale data acquisition and distribution, and relevant modular ... See full document

... We use as our illustrative example a workflow, AIRSN, that performs spatial normalization for pre- processing raw fMRI data prior to analysis. AIRSN normalizes sets of time series of 3D volumes to a ... See full document

... Orchestrating workflows needed for modern scientific data analysis presents a significant research challenge: they are typically executed in a centralised manner such that all data pass ... See full document

... multi workflows and single workflow. Scientific workflows are represented as Directed Acyclic Graph ...many scientific workflows for different scientific purpose such as Montage ... See full document

... The Metadata Registry holds the locations of files in VMs. It uses an in-memory distributed hash-table to hold key-value pairs: file ids (e.g., name, user, sharing group etc.) and locations (the information required by ... See full document

... the performance of on-demand processing framework, a prototype system is built for ...system, analysis models are described by java source codes, and some toolkits and libraries such as JDK and HDF library ... See full document

... Scientific workflows are becoming an important mechanism for scientists to combine scientific data management, analysis, simulation, and visualization ...tasks. Scientific ... See full document

... Both workflows are part of a family of workflows, that involve similar steps, known as deployment and monitoring workflows ...these workflows monitor and manage outputs from long-running ...of ... See full document

... large-scale scientific and engineering research is conducted from a tightly coupled computing environment to a geographically distributed resource sharing ...High Performance Computing (HPC) systems such as ... See full document

... give performance degradation and SLA violations if not used ...rations. Workflows is defined as many coarse-grained parallel tasks that are processed or executed in a specific order to accomplish a real ... See full document

... • Management and Analysis of Observatory Data using Kepler Scientific Workflows. • Overall goal: To bring together, for the first time , seamless access to sensor data from real- time[r] ... See full document