Alluxio 1.1.0 ·¢²¼ÁË£¬Alluxio ÊÇÒ»¸ö¸ßÈÝ´íµÄ·Ö²¼Ê½Îļþϵͳ£¬ÔÊÐíÎļþÒÔÄÚ´æµÄËÙ¶ÈÔÚ¼¯Èº¿ò¼ÜÖнøÐпɿ¿µÄ¹²Ïí£¬ÀàËÆSparkºÍ MapReduce¡£Í¨¹ýÀûÓÃlineageÐÅÏ¢£¬»ý¼«µØÊ¹ÓÃÄڴ棬AlluxioµÄÍÌÍÂÁ¿Òª±ÈHDFS¸ß300¶à±¶¡£Alluxio¶¼ÊÇÔÚÄÚ´æÖд¦Àí»º´æÎļþ£¬²¢ÇÒÈò»Í¬µÄ Jobs/QueriesÒÔ¼°¿ò¼Ü¶¼ÄÜÄÚ´æµÄËÙ¶ÈÀ´·ÃÎÊ»º´æÎļþ¡£
ÌØÐÔ£º
Àà Java µÄÎļþ API
¼æÈÝÐÔ£ºÊµÏÖ Hadoop Îļþϵͳ½Ó¿Ú
¿É²åÈëʽµÄµ×²ãÎļþϵͳ
ÄÚ½¨ Raw ÔÉú±íµÄÖ§³Ö
»ùÓÚ Web µÄ UI
ÌṩÃüÁîÐнӿÚ
±¾´Î¸üÐÂÈÕÖ¾ÈçÏ£º
ƽ̨ÌáÉý£º
Improved performance of metadata operations: Alluxio 1.1 master utilizes multiple CPUs more effectively, achieving up to 20x higher throughput and up to 5x lower 99 percentile latency for metadata heavy workloads.
Improved performance of reading Parquet files: Workloads with heavy random I/Os, such as reading Parquet files in Spark, are better supported, In particular, Alluxio now allows users to cache partially read blocks with higher read concurrency.
Improved performance of writing small files: By optimizing storage structures, Alluxio 1.1 achieves up to 1000x higher throughput when writing small files.
¿ÉÓÃÐÔÌáÉý£º
Simplified under storage metadata-loading process: Alluxio 1.1 greatly simplifies the work for users to surface under storage information in Alluxio. Loading information about files and directories from under storage now happens automatically the first time a file or directory is accessed.
Easy configuration: Alluxio configurations, such as conf/alluxio-env.sh, have been restructured to be simpler to reason about and maintain. Alluxio also provides easier ways to customize Alluxio properties for external jobs (e.g., Spark or MapReduce) which interact with Alluxio. These changes help admins who launch and maintain Alluxio as well as users who run applications on Alluxio.
Deployment without Sudo Access: To help users try out Alluxio, from the 1.1 release onward, Alluxio can be deployed without sudo access. This feature is targeted toward users who want to try out the system¡¯s features but do no require performance guarantees.
Under storage I/O delegation (Alpha): To simplify application development and maintenance, Alluxio 1.1 introduces an experimental option to read and write data from the under storage system through Alluxio workers. For example, applications will no longer require libraries to interact with under storage systems, greatly reducing the complexity to develop, configure, and maintain applications. This feature can be enabled by setting the flagalluxio.user.ufs.delegation.enabled=true and is disabled by default.
Improved user and file system permission checking: Alluxio provides permission semantics similar to the standard UNIX permission semantics, with command-line interfaces includingchmod, chown, and chgrp. This feature can be enabled by setting the flagalluxio.security.authorization.permission.enabled=true and is disabled by default.
й¦Äܼ¯³É£º
Integration with GCS and GCE: Alluxio supports using Google Cloud Storage (GCS) as an under storage system. Users can use the one-click Alluxio deployment to launch a cluster on Google Compute Engine (GCE) which is backed by GCS as the under storage.
Èí¼þÏêÇ飺http://www.alluxio.org/
ÏÂÔØµØÖ·£ºhttps://github.com/Alluxio/alluxio
À´×Ô:¿ªÔ´ÖйúÉçÇø

