SuperLinux Encyclopedia - High-Performance Computing

NOTE: A few of these links may be for just "distributed" computing which is not necessarily high-performance in the usual sense; just high-usefulness computing.

Definitions for use on this page:

• These are very fuzzy and often misused, so you might consider them synonymous for practical purposes.
• Multi-processing: Multiple CPUs on a common motherboard or backplane (a non-wire hardware bus).
• Clustered processing: Multiple coordinated computers on a fast locale area network.
• Distributed processing: Multiple coordinated computers on a wide area network.

Conferences:

• SC Conference Series  "The International Conference of High Performing Computing and Communications"
• SIGARCH (ACM's SC Supercomputing Conference)

Misc:

• Book: High Performance Computing (at O'Reilly)
• Beowolf:
  • beowulf.org
  • Beowulf Underground  News.
  • Avalon (Beowolf-class supercomputer; LOKI's "big brother")
  • LOKI - Commodity Parallel Processing (Beowolf-class supercomputer)
  • The Stone SouperComputer (Beowulf on old 486s at ORNL; with list of other Beowulf sites.)
  • Others: Loki with 16 Pentium Pro processors at the Energy Department's Los Alamos National Laboratory, Megalon and Daisy with 56 and 64 Pentium Pros, respectively, at DOE's Sandia National Laboratories, Alice2 with 16 Pentium Pros at DOE's Ames Research Laboratory, and the 128-Pentium Pro Hive at Goddard.
  • Ask Slashdot: What HDD should you use in a Beowulf Cluster?
• CCF - Collaborative Computing Frameworks (from Emory U.; for X).
• Cilk (C-addon specializing in fine-grain multi-threading for multiprocessors)
• Clusters:
  • Note that many links found elsewhere could be duplicated here.
  • The Cluster Cookbook (tbd: same as next one?)
  • SCL Cluster Cookbook "Building Your Own Clusters for Parallel Computation" (a HOWTO site)
  • Ask Slashdot: What is Clustering?
  • Clusterspace  "a object-oriented cluster management system" for Beowolf.
  • Eddie/Eddieware  "a set of cluster applications to be used when building highly robust and scalable server farms."
  • MP and Clustering for Linux and Related Info (at linas.org)
  • Some Clustering Discussion  Apr'98 LG
  • "Clusters and Extreme Linux"  From "Supercomputing '98"
  • The State of Linux Clustering  LinuxWorld Feb'99
• Extreme Linux Systems (at linas.org; large/fast actual systems)
• extremelinux.org
• Linux in High-Performance Computing
• Distributed processing, load balancing, job scheduling, etc.:
  • Note: This classification probably covers many entries found elsewhere on this page.
  • Amoeba Distributed OS (OS is distributed across multiple computers; free)
  • Avatar Job Scheduling Suite  $ and free-for-some. Super-cron? Multi-computer capable.
  • CommProc - Communications Processor  "a set of APIs and pre-constructed frameworks which build the components (clients and resources) of a message-based distributed-computing system."
  • Condor (SW runs on a cluster looking for idle computers and dispatching batch jobs to them; with good intro docs)
    "The goal of the Condor project is to develop, implement, deploy, and evaluate mechanisms and policies that support High Throughput Computing (HTC) on large collections of distributively owned computing resources."
  • distributed.net - node 0 (network of distributed computers; mostly code cracking)
  • dsh (a tool to distribute tasks to computers in a cluster)
  • Generic NQS Web Site "one of the world's leading freely-available batch processing systems"
  • Queue "load-balancing/distributed batch processing and local rsh replacement system"
  • Linux Network Address Translation (at linas.org; also covers load balancing, more)
• MP - MultiProcessing:
  • MP and Clustering for Linux and Related Info (at linas.org)
  • Orchestrate  High performance "business intelligence" multi-processor software.
• MOSIX (Adaptive resource managment SW for clusters; Linux port started Summer'98)
• Parallel Processing/Computing:
  • Linux Parallel Processing Sites  "photographs, descriptions, and contact information"

  • ARCH "Programming Tools for Concurrent and Parallel Processing"
  • Filaments "a library package that can be used to create architecture-independent parallel programs---that is, programs that are portable efficient across vastly different parallel machines"
  • Internet Parallel Computing Archive
  • Parallel Processing HOWTO (Discussion of parallel processing approaches for Linux.)
  • PATMOS - Parallel Asynchronous Transfer Mode Operating System  Developing a 256-node Alpha-Linux system.
• SMP:
  • SMP FAQ  LDP.
  • SMP FAQ (at Duke U.)
  • SMP FAQ official home page and US mirror
  • smp.tex - TeX document describing implementation of Multiprocessor Linux
  • Ask Slashdot: What's a good motherboard for SMP Linux
• Systems, preconfigured for sale:
  • AltaCluster Systems  Pre-configured Linux clusters; up to 1000 Alpha or Pentium II CPUs.
• TOP500 (A list of "Global Top 500" supercomputers.)

End of page.