红联Linux门户
Linux帮助

Spring XD 1.1 RC1发布

发布时间:2015-01-29 15:19:16来源:红联作者:empast
Spring XD 1.1 RC1 发布,此版本现已提供下载,包括一些新特性和 bug 修复,主要是 Stream 处理。Spring XD 1.1. M2 中处理模块引入了对 Reactor 的 Stream API 的支持。在 1.1 RC1 支持使用 RxJava 的 Observable API 和 Spark Streaming(支持现有的 Spark job)进行流处理。通过提供一系列的选项,你可以选择最适合任务的函数式编程模块。

Spark Streaming 集成特性如下:

XD Processor modules that act as drivers for workloads on the Spark Cluster.

An XD processor’s input DStream is generated from data received on the XD Message Bus, and the RDDs from its output DStream are sent to the bus.

The Spark Streaming driver process is automatically restarted if it dies due to the inherent module redeployment features of XD.

Simplify development and testing of Spark applications by decoupling your Spark computation code from code to setup input and output data.

RxJava 集成特性如下:

Development of processor modules using RxJava’s Observable API

Support for mapping input messages to one or multiple Observerble Stream instances

Refer to the rxjava-moving-average project for an example of using RxJava’s Observable API.

其他特性

Container Group Management when running XD on YARN.

Refactored Kafka Based Message Bus and Kafka Source based on the new Spring Integration Kafka client library.

Gemfire source and sink support for multiple locators.

Improved tooling and updated examples for custom module development.

更多内容请看发行说明。

Spring XD 是一个统一的,分布式,可扩展的系统用于数据摄取,实时分析,批量处理和数据导出。该项目的目标是简化大数据应用的开发。

软件详情:http://spring.io/blog/2015/01/29/spring-xd-1-1-rc1-released

下载地址:http://repo.spring.io/libs-milestone/org/springframework/xd/spring-xd/1.1.0.RC1/spring-xd-1.1.0.RC1-dist.zip

来自:开源中国社区
文章评论

共有 0 条评论