Date: Mon, 10 Dec 2012 12:36:53 +0900
--------------------------------------------------
Supercomputing '12 (SC '12) で開催された
7th Parallel Data Storage Workshop (PSDW)
held in conjunction with Supercomputing '12
November 12, 2012
http://www.pdsw.org/index.shtml
の Paper、Slideが公開されています：
タイトル：
SESSION 1: REPRESENTING STRUCTURE IN DATA
"Discovering Structure in Unstructured I/O"
*)PLFS https://github.com/PLFS
"Compressing Intermediate Keys between Mappers and Reducers in SciHadoop"
"Towards Dynamic Scripted pNFS Layouts"
SESSION 2: OBSERVING AND OPTIMIZING
"IOPin: Runtime Profiling of Parallel I/O in HPC Systems"
"SAN Optimization for High Performance Storage with RDMA Data Transfer"
*)PCI Board Storage
http://211.170.88.3/taejin/products/page_05_01.asp?RPG=page_05
"A Case for Scaling HPC Metadata Performance through De-specialization"
SESSION 3: ALTERNATIVE STORAGE MODELS
"An Evolutionary Path to Object Storage Access"
*)PVFS2 http://www.pvfs.org/
"DataMods: Programmable File System Services"
*)PLFS
"A Case for Optimistic Coordination in HPC Storage Systems"
POSTER SESSION
http://www.pdsw.org/postersession.shtml
Reprints from my posting to SAN-Tech Mailing List and ...
2012/12/10
2012/07/05
[san-tech][03572] Slide: 2012 Red Hat Summit and JBossWord (June 26-29, 2012)
Date: Thu, 05 Jul 2012 05:16:48 +0900
--------------------------------------------------
2012年 6月 26日～29日に開催された
2012 Red Hat Summit and JBossWord, June 26-29, 2012
http://www.redhat.com/summit/
Agenda
http://www.redhat.com/summit/agenda/
の Slideが公開されています：
Presentations
http://www.redhat.com/summit/2012/presentations/
--------------------------------------------------
2012年 6月 26日～29日に開催された
2012 Red Hat Summit and JBossWord, June 26-29, 2012
http://www.redhat.com/summit/
Agenda
http://www.redhat.com/summit/agenda/
の Slideが公開されています：
Presentations
http://www.redhat.com/summit/2012/presentations/
2012/03/08
[san-tech][03473] Video/Slide: Using Hadoop for HPC Applications (NERSC Training Event) & Cloudera Seismic Hadoop
Date: Thu, 08 Mar 2012 20:43:12 +0900
--------------------------------------------------
US NERSC (National Energy Research Scientific Computing Center) で
2011年 10月 5日に開催されたトレーニングのビデオが資料と共に公開されて
います：
Using Hadoop for HPC Applications
Lavanya Ramakrishnan, NERSC Technology Integration Group
http://www.nersc.gov/users/training/nersc-training-events/hadoop-for-hpc/
"The tutorial will provide an overview of Hadoop technologies,
discuss some use cases of Hadoop for science and present
the programming challenges with using Hadoop for legacy applications."
--------------------------------------------------
US NERSC (National Energy Research Scientific Computing Center) で
2011年 10月 5日に開催されたトレーニングのビデオが資料と共に公開されて
います：
Using Hadoop for HPC Applications
Lavanya Ramakrishnan, NERSC Technology Integration Group
http://www.nersc.gov/users/training/nersc-training-events/hadoop-for-hpc/
"The tutorial will provide an overview of Hadoop technologies,
discuss some use cases of Hadoop for science and present
the programming challenges with using Hadoop for legacy applications."
[san-tech][03471] Slide & Video: Strata 2012 - O'Reilly Conferences (Feb. 28 - Mar. 01, 2012)
Date: Thu, 08 Mar 2012 14:33:13 +0900
--------------------------------------------------
2012年 2月 28日～3月 1日に開催された
Strata 2012 - O'Reilly Conferences, February 28 - March 01, 2012
About
http://strataconf.com/strata2012/public/content/about
の講演資料やビデオが公開されてます：
Strata 2012 Speaker Slides & Video
http://strataconf.com/strata2012/public/schedule/proceedings
Strata 2012 Schedule
http://strataconf.com/strata2012/public/schedule/grid/public
Youtube (主として Interview)
Strata CA 2012, O'Reilly
http://www.youtube.com/playlist?list=PLA8F8634D3F361EE6
--------------------------------------------------
2012年 2月 28日～3月 1日に開催された
Strata 2012 - O'Reilly Conferences, February 28 - March 01, 2012
About
http://strataconf.com/strata2012/public/content/about
の講演資料やビデオが公開されてます：
Strata 2012 Speaker Slides & Video
http://strataconf.com/strata2012/public/schedule/proceedings
Strata 2012 Schedule
http://strataconf.com/strata2012/public/schedule/grid/public
Youtube (主として Interview)
Strata CA 2012, O'Reilly
http://www.youtube.com/playlist?list=PLA8F8634D3F361EE6
ラベル:
Cloud,
Event,
Hadoop,
Management,
Network,
Software,
Storage,
Technology
2012/03/01
[san-tech][03453] "Cray's YarcData Division Launches New Big Data Graph Appliance", Feb 29, 2012
Date: Thu, 01 Mar 2012 14:57:40 +0900
--------------------------------------------------
2021/03/03
"Cray Parlays Supercomputing Technology Into Big Data Appliance"
March 01, 2012, HPCwire
http://www.hpcwire.com/hpcwire/2012-03-01/cray_parlays_supercomputing_technology_into_big_data_appliance.html
"Cray gets graphic with big data"
ThreadStorm appliance cries 'Urika!'
1st March 2012, The Register
http://www.theregister.co.uk/2012/03/01/cray_urika_big_data_appliance/
--------------------------------------------------
Crayから Big Data Graph Appliance (実際はラック) が発表されました：
"Cray's YarcData Division Launches New Big Data Graph Appliance"
Feb 29, 2012
http://investors.cray.com/phoenix.zhtml?c=98390&p=irol-newsArticle&ID=1667153
"... dedicated to providing "Big Data" solutions for enterprise
customers, today announced the launch of the YarcData uRiKA
graph appliance -- a purpose-built solution for Big Data relationship
analytics -- at the 2012 Strata Conference in Santa Clara, California."
※2012 Strata Conferenceでの Premier Exhibitorsはこのため？
--------------------------------------------------
2021/03/03
"Cray Parlays Supercomputing Technology Into Big Data Appliance"
March 01, 2012, HPCwire
http://www.hpcwire.com/hpcwire/2012-03-01/cray_parlays_supercomputing_technology_into_big_data_appliance.html
"Cray gets graphic with big data"
ThreadStorm appliance cries 'Urika!'
1st March 2012, The Register
http://www.theregister.co.uk/2012/03/01/cray_urika_big_data_appliance/
--------------------------------------------------
Crayから Big Data Graph Appliance (実際はラック) が発表されました：
"Cray's YarcData Division Launches New Big Data Graph Appliance"
Feb 29, 2012
http://investors.cray.com/phoenix.zhtml?c=98390&p=irol-newsArticle&ID=1667153
"... dedicated to providing "Big Data" solutions for enterprise
customers, today announced the launch of the YarcData uRiKA
graph appliance -- a purpose-built solution for Big Data relationship
analytics -- at the 2012 Strata Conference in Santa Clara, California."
※2012 Strata Conferenceでの Premier Exhibitorsはこのため？
2011/07/31
[san-tech][03314] "How Facebook moved 30 petabytes of Hadoop data", Jul. 27, 2011, GigaOM
Date: Sat, 30 Jul 2011 21:03:25 +0900
--------------------------------------------------
また Hadoop関連ですが、
"How Facebook moved 30 petabytes of Hadoop data"
Jul. 27, 2011, GigaOM
http://gigaom.com/cloud/facebook-hadoop-cluster/
"... Today, it shared the latest of those innovations - moving its
whopping 30-petabyte cluster from one data center to another."
"... The move was necessary because Facebook had run out of both
power and space to expand the cluster ? very likely the largest
in the world - and had to find it a new home. Yang writes that
there were two options, physical migration of the machines or
replication, and Facebook chose replication to minimize downtime."
--------------------------------------------------
また Hadoop関連ですが、
"How Facebook moved 30 petabytes of Hadoop data"
Jul. 27, 2011, GigaOM
http://gigaom.com/cloud/facebook-hadoop-cluster/
"... Today, it shared the latest of those innovations - moving its
whopping 30-petabyte cluster from one data center to another."
"... The move was necessary because Facebook had run out of both
power and space to expand the cluster ? very likely the largest
in the world - and had to find it a new home. Yang writes that
there were two options, physical migration of the machines or
replication, and Facebook chose replication to minimize downtime."
2011/07/30
[san-tech][03313] Hortonworks (Re: Yahoo、Hadoop部隊を Spin Outへ)
Date: Sat, 30 Jul 2011 20:20:25 +0900
--------------------------------------------------
[san-tech][03234] Yahoo、Hadoop部隊を Spin Outへ
Date: Fri, 01 Jul 2011 00:37:13 +0900
--------------------------------------------------
すっかりフォローを忘れていて、既にご存じの方も多いと思いますが、
"Yahoo! and Benchmark Capital to Form Hortonworks to Increase Investment
in Hadoop Technology and Accelerate Innovation and Adoption"
Independent Company Dedicated to Working with Apache Hadoop Community
to Architect the Future of Big Data
June 28, 2011
http://www.hortonworks.com/about-us/news/
"Yahoo! Inc. (NASDAQ: YHOO) and Benchmark Capital today announced
the formation of Hortonworks, an independent company consisting of
key architects and core contributors to the open source Apache Hadoop
technology pioneered by Yahoo!."
--------------------------------------------------
[san-tech][03234] Yahoo、Hadoop部隊を Spin Outへ
Date: Fri, 01 Jul 2011 00:37:13 +0900
--------------------------------------------------
すっかりフォローを忘れていて、既にご存じの方も多いと思いますが、
"Yahoo! and Benchmark Capital to Form Hortonworks to Increase Investment
in Hadoop Technology and Accelerate Innovation and Adoption"
Independent Company Dedicated to Working with Apache Hadoop Community
to Architect the Future of Big Data
June 28, 2011
http://www.hortonworks.com/about-us/news/
"Yahoo! Inc. (NASDAQ: YHOO) and Benchmark Capital today announced
the formation of Hortonworks, an independent company consisting of
key architects and core contributors to the open source Apache Hadoop
technology pioneered by Yahoo!."
[san-tech][03312] YouTube: Hadoop Summit 2011, June 29, 2011
Date: Sat, 30 Jul 2011 03:49:29 +0900
--------------------------------------------------
--------------------------------------------------
2011年 6月 29日に開催された
Hadoop Summit 2011
のスライド入り講演ビデオ (Summit videos with embeded presentations) が
公開されています。少しづつ追加されているようです。現在 16編、午前の講演
はアップ済み。
2011/07/04
[san-tech][03244] "Apache Hadoop: The Scalability Update", June 2011, ;login:, The USENIX Magazine
Date: Mon, 04 Jul 2011 06:11:19 +0900
--------------------------------------------------
--------------------------------------------------
;login:, The USENIX Magazine、June 2011 (Volume 36, Number 3) で、
"Apache Hadoop: The Scalability Update"
Konstantin V. Shvachko
Principal Hadoop architect at eBay
が一般に公開されています (他にもいくつか公開されてます、URLは文末)。
"Scalability is one of the primary forces driving popularity and
adoption of the Apache Hadoop project. A typical use case for Hadoop
is an emerging Web site starting to run a five-node Hadoop cluster
and then gradually increasing it to hundreds of nodes as business
grows.
Last year ;login: published my article [12] summarizing one aspect of
Hadoop scalability, namely, the limits of scalability of the Hadoop
Distributed File System [13]. There are many other dimensions to
Hadoop scalability. Here I would like to address some of them."
2011/07/01
[san-tech][03236] Realtime Hadoop usage at Facebook, SIGMOD2011
Date: Fri, 01 Jul 2011 16:18:35 +0900
--------------------------------------------------
Facebook技術者による、Hadoopの Peta-byte scale規模での Realtime Workload対応
についての解説 Blogです (ACM SIGMOD 2011で発表)：
"Realtime Hadoop usage at Facebook -- Part 1"
May 17, 2011, HDFS, Dhruba Borthakur, Facebook
http://hadoopblog.blogspot.com/2011/05/realtime-hadoop-usage-at-facebook-part.html
"Realtime Hadoop usage at Facebook -- Part 2 - Workload Types"
May 28, 2011, HDFS, Dhruba Borthakur, Facebook
http://hadoopblog.blogspot.com/2011/05/realtime-hadoop-usage-at-facebook-part_28.html
"Facebook recently deployed Facebook Messages, its first ever
user-facing application built on the Apache Hadoop platform. It uses
HDFS and HBase as core technologies for this solution. Since then,
there are many more applications that have started to used HBase.
We have gained some experience in deploying and operating HDFS and
HBase at peta-byte scale for realtime-workloads and decided to
write a paper detailing some of these insights. This paper will be
published in SIGMOD 2011." (Part 1)
--------------------------------------------------
Facebook技術者による、Hadoopの Peta-byte scale規模での Realtime Workload対応
についての解説 Blogです (ACM SIGMOD 2011で発表)：
"Realtime Hadoop usage at Facebook -- Part 1"
May 17, 2011, HDFS, Dhruba Borthakur, Facebook
http://hadoopblog.blogspot.com/2011/05/realtime-hadoop-usage-at-facebook-part.html
"Realtime Hadoop usage at Facebook -- Part 2 - Workload Types"
May 28, 2011, HDFS, Dhruba Borthakur, Facebook
http://hadoopblog.blogspot.com/2011/05/realtime-hadoop-usage-at-facebook-part_28.html
"Facebook recently deployed Facebook Messages, its first ever
user-facing application built on the Apache Hadoop platform. It uses
HDFS and HBase as core technologies for this solution. Since then,
there are many more applications that have started to used HBase.
We have gained some experience in deploying and operating HDFS and
HBase at peta-byte scale for realtime-workloads and decided to
write a paper detailing some of these insights. This paper will be
published in SIGMOD 2011." (Part 1)
[san-tech][03234] Yahoo、Hadoop部隊を Spin Outへ
Date: Fri, 01 Jul 2011 00:37:13 +0900
--------------------------------------------------
前にも噂になりましたが、Yahooが Hadoopプロジェクトを Spin Outすることが
ほぼ確実になったようです (新会社の経営陣の名前が特定されています)：
"Yahoo Spins Out Hadoop Startup"
June 29, 2011, Network Computing
http://www.networkcomputing.com/cloud-storage/231000699
http://www.networkcomputing.com/cloud-storage/231000699?pgno=2
http://www.networkcomputing.com/cloud-storage/231000699?pgno=3
※私の環境 (FireFox 5.0) では文字が表示された瞬間にロードを止めないと、
無限リロード地獄に陥ります (あっというまに CPU/Memory Usageが・・・)
"A core development group at Yahoo is being given venture capital
backing and will be spun off to further the rapid enterprise-style
development of Hadoop. Within a few days, "something over 20" core
committers and architects of Hadoop code will move off the Yahoo
campus in Sunnyvale, Calif., into offices nearby to form Hortonworks,
an independent company, said Eric Baldeschweiler, Yahoo's VP of
software engineering for Hadoop, in an interview. He will become
CEO of the new firm."
--------------------------------------------------
前にも噂になりましたが、Yahooが Hadoopプロジェクトを Spin Outすることが
ほぼ確実になったようです (新会社の経営陣の名前が特定されています)：
"Yahoo Spins Out Hadoop Startup"
June 29, 2011, Network Computing
http://www.networkcomputing.com/cloud-storage/231000699
http://www.networkcomputing.com/cloud-storage/231000699?pgno=2
http://www.networkcomputing.com/cloud-storage/231000699?pgno=3
※私の環境 (FireFox 5.0) では文字が表示された瞬間にロードを止めないと、
無限リロード地獄に陥ります (あっというまに CPU/Memory Usageが・・・)
"A core development group at Yahoo is being given venture capital
backing and will be spun off to further the rapid enterprise-style
development of Hadoop. Within a few days, "something over 20" core
committers and architects of Hadoop code will move off the Yahoo
campus in Sunnyvale, Calif., into offices nearby to form Hortonworks,
an independent company, said Eric Baldeschweiler, Yahoo's VP of
software engineering for Hadoop, in an interview. He will become
CEO of the new firm."
2011/06/30
[san-tech][03230] MapR: 2つのディストリビューションを公開、June 29, 2011
Date: Thu, 30 Jun 2011 19:21:47 +0900
--------------------------------------------------
以前紹介した MapRが 2つのディストリビューションを公開しました：
※今までは EMCとの提携
"MapR Technologies Announces Availability of the Industry's Easiest,
Fastest and Most Dependable Distribution for Apache Hadoop"
Free version of MapR now available
June 29, 2011
http://www.mapr.com/company/press-releases/mapr-technologies-announces-availability-of-the-industrys-easiest-fastest-and-most-dependable-distribution-for-apache-hadoop.html
"... today announced significant and innovative breakthroughs in the
world of Hadoop big data software, unveiling its unmatched
enterprise-ready software. The MapR Distribution for Apache Hadoop
provides 2 to 5 times performance improvements and brings
unprecedented dependability to MapReduce analytics. In addition to
its radical ease-of-use capabilities, the MapR Distribution for
Apache Hadoop enables customers to reduce their required hardware
costs by half, making it possible for more organizations to harness
the power of big data analytics for competitive advantage. The MapR
Distribution includes popular open-source community tools and
capabilities such as Hbase, Hive, Cascading and Zookeeper, among
others, and is available for download here."
--------------------------------------------------
以前紹介した MapRが 2つのディストリビューションを公開しました：
※今までは EMCとの提携
"MapR Technologies Announces Availability of the Industry's Easiest,
Fastest and Most Dependable Distribution for Apache Hadoop"
Free version of MapR now available
June 29, 2011
http://www.mapr.com/company/press-releases/mapr-technologies-announces-availability-of-the-industrys-easiest-fastest-and-most-dependable-distribution-for-apache-hadoop.html
"... today announced significant and innovative breakthroughs in the
world of Hadoop big data software, unveiling its unmatched
enterprise-ready software. The MapR Distribution for Apache Hadoop
provides 2 to 5 times performance improvements and brings
unprecedented dependability to MapReduce analytics. In addition to
its radical ease-of-use capabilities, the MapR Distribution for
Apache Hadoop enables customers to reduce their required hardware
costs by half, making it possible for more organizations to harness
the power of big data analytics for competitive advantage. The MapR
Distribution includes popular open-source community tools and
capabilities such as Hbase, Hive, Cascading and Zookeeper, among
others, and is available for download here."
2011/06/09
[san-tech][03142] Re: MapR: "Next Generation Hadoop Distribution"
Date: Thu, 02 Jun 2011 13:26:58 +0900
--------------------------------------------------
[san-tech][03135] MapR: "Next Generation Hadoop Distribution"
GigaOMによる続報等です。
"Why MapR Is Right to Give Back to Apache Hadoop"
Jun. 1, 2011
http://gigaom.com/cloud/why-mapr-is-right-to-give-back-to-apache-hadoop/
"Big data startup MapR is now an official corporate contributor to
the Apache Hadoop project, a somewhat interesting turn of affairs
given its corporate mission to lure users away from Apache's
Hadoop Distributed File System."
--------------------------------------------------
[san-tech][03135] MapR: "Next Generation Hadoop Distribution"
GigaOMによる続報等です。
"Why MapR Is Right to Give Back to Apache Hadoop"
Jun. 1, 2011
http://gigaom.com/cloud/why-mapr-is-right-to-give-back-to-apache-hadoop/
"Big data startup MapR is now an official corporate contributor to
the Apache Hadoop project, a somewhat interesting turn of affairs
given its corporate mission to lure users away from Apache's
Hadoop Distributed File System."
[san-tech][03135] MapR: "Next Generation Hadoop Distribution"
Date: Mon, 30 May 2011 19:33:26 +0900
--------------------------------------------------
2010/06/09
[san-tech][03142] Re: MapR: "Next Generation Hadoop Distribution"
--------------------------------------------------
MapR Technologies社から、新しい Hadoopがアナウンスされました。
GA (一般販売) はまだ先で、まずは EMCとの提携から：
"MapR Technologies and EMC Announce Technology Licensing Agreement
for Next Generation Hadoop Distribution"
May 25, 2011
http://www.mapr.com/mapr-emc-oem-for-hadoop.html
"... today announced a software licensing agreement with EMC
Corporation (NYSE:EMC) in which MapR Technologies will be part of
the recently announced EMCR Greenplum HD Enterprise Edition,
a 100 percent interface-compatible implementation of the Apache
Hadoop software stack. The new EMC system will incorporate MapR
Technologies' pre-integrated, tested and hardened distribution
for Apache Hadoop."
--------------------------------------------------
2010/06/09
[san-tech][03142] Re: MapR: "Next Generation Hadoop Distribution"
--------------------------------------------------
MapR Technologies社から、新しい Hadoopがアナウンスされました。
GA (一般販売) はまだ先で、まずは EMCとの提携から：
"MapR Technologies and EMC Announce Technology Licensing Agreement
for Next Generation Hadoop Distribution"
May 25, 2011
http://www.mapr.com/mapr-emc-oem-for-hadoop.html
"... today announced a software licensing agreement with EMC
Corporation (NYSE:EMC) in which MapR Technologies will be part of
the recently announced EMCR Greenplum HD Enterprise Edition,
a 100 percent interface-compatible implementation of the Apache
Hadoop software stack. The new EMC system will incorporate MapR
Technologies' pre-integrated, tested and hardened distribution
for Apache Hadoop."
登録:
投稿 (Atom)