這些年,我們一起追的Hadoop
Hadoop 簡史 5 / 74 The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed / 74 我們對 Hadoop 的期許: Batch Job Interactive Query Real-Time Processing Graph Processing Iterative Modeling 人心不足蛇吞象 Hadoop 的體質 (Batch Processing) 問題: 每次就是一個 Batch Job,一個接著一個 每個 Batch Job 做的事就是讀入所有資料、處理、寫出結果 (HDFS),但是提供多種玩法 (YARN)! 希望把 Hadoop 從 Batch 應用變成 Data Operating System: 透過 MapReduce 進行 Batch Processing 透過 Hive 與 Tez 進行 Interactive SQL Query ... 15 / 74 MapReduce 改造前 Hadoop 原來的架構,MapReduce 是一切應用的基礎0 码力 | 74 页 | 45.76 MB | 1 年前3julia 1.10.10
of Finalizers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 308 25 Multi-processing and Distributed Computing 310 25.1 Code Availability and Loading Packages . . . . . . . . . . variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 416 34.3 Measure performance with @time and pay attention to memory allocation . . . . . . 417 34.4 Tools . . . . . . . . . . . . . . . event structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1362 78.2 Processing log events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1363 78.3 Testing0 码力 | 1692 页 | 6.34 MB | 3 月前3Julia 1.10.9
of Finalizers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 308 25 Multi-processing and Distributed Computing 310 25.1 Code Availability and Loading Packages . . . . . . . . . . variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 416 34.3 Measure performance with @time and pay attention to memory allocation . . . . . . 417 34.4 Tools . . . . . . . . . . . . . . . event structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1362 78.2 Processing log events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1363 78.3 Testing0 码力 | 1692 页 | 6.34 MB | 3 月前3Julia 1.11.6 Release Notes
of Finalizers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 327 26 Multi-processing and Distributed Computing 329 26.1 Code Availability and Loading Packages . . . . . . . . . . variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 444 35.3 Measure performance with @time and pay attention to memory allocation . . . . . . 445 35.4 Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . 476 35.31 Execution latency, package loading and package precompiling time . . . . . . . . . 476 36 Workflow Tips 479 36.1 REPL-based workflow . . . . . . . . . . . . . .0 码力 | 2007 页 | 6.73 MB | 3 月前3Julia 1.11.4
of Finalizers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 327 26 Multi-processing and Distributed Computing 329 26.1 Code Availability and Loading Packages . . . . . . . . . . variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 444 35.3 Measure performance with @time and pay attention to memory allocation . . . . . . 445 35.4 Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . 476 35.31 Execution latency, package loading and package precompiling time . . . . . . . . . 476 36 Workflow Tips 479 36.1 REPL-based workflow . . . . . . . . . . . . . .0 码力 | 2007 页 | 6.73 MB | 3 月前3Julia 1.11.5 Documentation
of Finalizers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 327 26 Multi-processing and Distributed Computing 329 26.1 Code Availability and Loading Packages . . . . . . . . . . variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 444 35.3 Measure performance with @time and pay attention to memory allocation . . . . . . 445 35.4 Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . 476 35.31 Execution latency, package loading and package precompiling time . . . . . . . . . 476 36 Workflow Tips 479 36.1 REPL-based workflow . . . . . . . . . . . . . .0 码力 | 2007 页 | 6.73 MB | 3 月前3Julia 1.12.0 RC1
of Finalizers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 331 26 Multi-processing and Distributed Computing 333 26.1 Code Availability and Loading Packages . . . . . . . . . . Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 437 33.5 Wall-time Profiler . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 438 33.6 Memory . . . . . . . . . . . . . . 475 35.5 Execution latency, package loading and package precompiling time . . . . . . . . . 482 35.6 Miscellaneous . . . . . . . . . . . . . . . . . . . . . . . . . . . .0 码力 | 2057 页 | 7.44 MB | 3 月前3Julia 1.12.0 Beta4
of Finalizers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 331 26 Multi-processing and Distributed Computing 332 26.1 Code Availability and Loading Packages . . . . . . . . . . Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 436 33.5 Wall-time Profiler . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 437 33.6 Memory . . . . . . . . . . . . . . 474 35.5 Execution latency, package loading and package precompiling time . . . . . . . . . 481 35.6 Miscellaneous . . . . . . . . . . . . . . . . . . . . . . . . . . . .0 码力 | 2057 页 | 7.44 MB | 3 月前3Julia 1.12.0 Beta3
of Finalizers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 331 26 Multi-processing and Distributed Computing 332 26.1 Code Availability and Loading Packages . . . . . . . . . . Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 436 33.5 Wall-time Profiler . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 437 33.6 Memory . . . . . . . . . . . . . . 474 35.5 Execution latency, package loading and package precompiling time . . . . . . . . . 481 35.6 Miscellaneous . . . . . . . . . . . . . . . . . . . . . . . . . . . .0 码力 | 2057 页 | 7.44 MB | 3 月前3julia 1.12.0 beta1
of Finalizers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 331 26 Multi-processing and Distributed Computing 332 26.1 Code Availability and Loading Packages . . . . . . . . . . Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 436 33.5 Wall-time Profiler . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 437 33.6 Memory . . . . . . . . . . . . . . 474 35.5 Execution latency, package loading and package precompiling time . . . . . . . . . 481 35.6 Miscellaneous . . . . . . . . . . . . . . . . . . . . . . . . . . . .0 码力 | 2047 页 | 7.41 MB | 3 月前3
共 37 条
- 1
- 2
- 3
- 4