The HPC Show - Channel 9

HPC Basic Profile with Steven Newhouse (5/5) -- SOA Sessions

wenmingye — Mon, 25 Aug 2008 00:06:00 GMT

HPC Basic Profile Web Service or the HPCBP for short, is a web service, built using the Windows Communication Foundation (WCF) that provides access to some of HPCS 2008’s core job submission functionality.

Part 5 -- SOA Sessions

-Brief Description of the WCF Broker model
-HPCBP-SOA xml schema
-Controlling the SOA Session

HPC Basic Profile with Steven Newhouse (4/5) -- File Staging

wenmingye — Mon, 25 Aug 2008 00:01:00 GMT

HPC Basic Profile Web Service or the HPCBP for short, is a web service, built using the Windows Communication Foundation (WCF) that provides access to some of HPCS 2008’s core job submission functionality.

Part 4 -- Submitting a job with File Staging

-Users need to setup a place to store files for a job.
-Specify Download and Upload files are supported using the file staging extension of JDSL.
-May use the IIS's ftp server.
-Staging, cleaning up files before and after a job submission are allowed.

HPC Basic Profile with Steven Newhouse (3/5) -- Submitting a Job

wenmingye — Sun, 24 Aug 2008 23:51:00 GMT

HPC Basic Profile with Steven Newhouse (2/5) -- the SDK

wenmingye — Sun, 24 Aug 2008 23:44:00 GMT

HPC Basic Profile Web Service or the HPCBP for short, is a web service, built using the Windows Communication Foundation (WCF) that provides access to some of HPCS 2008’s core job submission functionality.

Part 2-- the SDK

Covers the following topics:
-API in c#, XML schema.
-Setting up and running the java client example
-WSDL generation
-Example implementation details
-Code sigining/Certificates generation
-Headnode Configurations

HPC Basic Profile with Steven Newhouse (1/5) -- What is the HPC Basic Profile?

wenmingye — Sun, 24 Aug 2008 23:35:00 GMT

HPC Basic Profile Web Service or the HPCBP for short, is a web service, built using the Windows Communication Foundation (WCF) that provides access to some of HPCS 2008’s core job submission functionality.

Part 1-- HPC Basic Profile Details

Covers the following topics:

-Basic descriptions of Basic Execution Service.
-Job Submission Description Language (JSDL)
-HPC Basic Profile: customization of BES with a defined security model.
-File staging extension of HPCBP
-Linux and Windows scheduler interops

HPC Basic Profile with Steven Newhouse (Intro)

wenmingye — Sun, 24 Aug 2008 23:00:00 GMT

Over the last few years, using an open process within the Open Grid Forum (OGF), developers from industry and research from both the open source and commercial software communities, have come to agreement on the web service interface and protocols that can provide greatest interoperability. These set of specifications are encapsulated within the HPC Basic Profile 1.0.

In this 5 parts video, Steven Newhouse, our HPC BP program manager gives a lecture on the details of HPC Basic Profile, the Microsoft SDK, examples of how to submit a job, pre-staging files, and starting a SOA session.

Windows HPC #23 on the June 2008 Top 500 Supercomputer List

philpenn — Mon, 04 Aug 2008 22:43:00 GMT

Join members of the Windows HPC Performance Team for a discussion of the recent attainment of number 23 on the Top 500 supercomputer list. Also preview a new utility to be released with Windows HPC Server 2008 that enables automatic Linpack benchmark cluster performance profiling.

Windows HPC Server 2008 is available as a Release Candidate as of July, 2008. Obtain the beta bits at http://connect.microsoft.com/. Please provide feedback using the feedback tool on the Connect web site.

For additional information, see http://windowshpc.net/ and http://edge.technet.com/Tags/HPC/.

Are You Sane?

philpenn — Wed, 23 Jul 2008 21:21:00 GMT

Are You Sane?

Well, not you personally... but rather is your HPC cluster sane?   This is often the first question asked upon cluster deployment.   It's not necessarily an easy question to answer as potential performance issues exist at many levels.

Join HPC guru Frank Chism as he illustrates the features and use of his "uSane" toolkit.

CAUTION: This video is just a teaser sampling.

You'll want to try the uSane toolkit yourself.  Get uSane along with the full video.   Learn more about this offer at http://blogs.msdn.com/philpenn/archive/2008/07/23/test-your-sanity.aspx.

Windows HPC Server 2008 is available as a Release Candidate as of July, 2008. Obtain the beta bits at http://connect.microsoft.com. Please provide feedback using the feedback tool on the Connect web site.

For additional information, see http://WindowsHPC.net and http://edge.technet.com/Tags/HPC/.

Microsoft Excel-Compute cluster server ADAPTER Demo

wenmingye — Sat, 28 Jun 2008 06:14:00 GMT

This sample code demonstrates one of the earlier creative ways of providing an Excel client integrated solution for windows compute cluster server. WCCS is the version 1 of the Microsoft high performance computing solution. The Excel CCS adaptor sample makes its User Defined Function calls through job submission, COM Proxy and file shares, it works with both V1 and V2 of the product. The adaptor tool's auto proxy distributor allows an end user to cluster-enable their XLLs without having to do any additional programming.

Version 2 of the product will fully support the new WCF Broker model architecture, where short calls can be efficiently served by WCF SOA model.

We will be looking at more ways to integrate Excel-HPC solutions in the near future.

Source code is avaiable on download.microsoft.com

Windows HPC WCF Integration Part 4/4

wenmingye — Sat, 28 Jun 2008 03:16:00 GMT

In this video, Ming Xu, our program manager at Windows High Performance Computing Group explains the new WCF architecture on Windows HPC V2. He shows us step by step, how to create WCF High Performance Computing applications. (Part 4/4)

Windows HPC WCF Integration Part 3/4

wenmingye — Sat, 28 Jun 2008 02:44:00 GMT

Windows HPC WCF Integration Part 2/4

wenmingye — Sat, 28 Jun 2008 02:26:00 GMT

Event Tracing with Microsoft MPI

philpenn — Sat, 28 Jun 2008 02:14:00 GMT

Robert is a Senior PM with the Windows HPC Server product team. Join Robert as he illustrates new MPI tracing features.

Windows HPC Server 2008 is available in beta with RC1 coming soon. Obtain the beta bits at http://connect.microsoft.com/. Please provide feedback using the feedback tool on the Connect web site.

For additional information, see http://windowshpc.net/ and http://edge.technet.com/Tags/HPC/. Also look for detailed MPI tracing instructions at http://code.msdn.microsoft.com/hpc.

Windows HPC WCF Integration Part 1/4

wenmingye — Sat, 28 Jun 2008 02:12:00 GMT

Intro to Cluster Diagnostics and Node Deployment

philpenn — Thu, 06 Mar 2008 07:00:44 GMT

Cathy is a Senior PM on the HPC Server 2008 product team. Follow along as Cathy demonstrates new diagnostics and deployment features.

Windows HPC Server 2008 is available in a Beta1 release as of November, 2007, with Beta2 scheduled for release in Spring, 2008. Obtain the beta bits at http://connect.microsoft.com. Please provide feedback using the feedback tool on the Connect web site.

For additional information, see http://WindowsHPC.net and http://edge.technet.com/Tags/HPC/.

Five Minute Intro to the HPC Server 2008 Management Console

philpenn — Thu, 06 Mar 2008 05:20:59 GMT

Cathy is a Senior PM on the HPC Server 2008 product team. Follow along as Cathy demonstrates the new Cluster Management Console.

Windows HPC Server 2008 is available in a Beta1 release as of November, 2007, with Beta2 scheduled for release in Spring 2008. Obtain the beta bits at http://connect.microsoft.com. Please provide feedback using the feedback tool on the Connect web site.

For additional information, see http://WindowsHPC.net.

New OGF Web Service Interface with Windows HPC Server 2008

philpenn — Wed, 02 Jan 2008 21:29:19 GMT

Steven is a member of the Windows HPC Server 2008 product team responsible for design and development of the new Open Grid Forum compatible Web Service interface. This new interface enables client HPC applications to interact with the compute cluster job scheduler in a vendor-neutral manner.

Learn more about this and other new features via the community website at http://WindowsHPC.net.

The video is a bit long for Channel9 (~30 min). You may wish to download the entire WMV file, open it via the Windows Media Player, and select the fast play speed option, "Ctrl+Shift+G".

New Job Scheduler Features with Windows HPC Server 2008

philpenn — Tue, 18 Dec 2007 07:14:40 GMT

Josh is a PM on the HPC Server 2008 product team. Listen to Josh detail the new Job Scheduler policies, algorithms, and interfaces.

Windows HPC Server 2008 is available in a Beta1 release as of November, 2007. Obtain the beta bits at http://connect.microsoft.com. Please provide feedback using the feedback tool on the Connect web site.

For additional information, see http://WindowsHPC.net and http://blogs.msdn.com/philpenn.

New performance enhancements for MPI applications running on HPC Server 2008

philpenn — Tue, 18 Dec 2007 04:11:11 GMT

Eric is a member of the HPC Server product team. Listen to Eric describe the new Network Direct RDMA interface and related performance observations. Microsoft's MPI library is the first user-mode application that is also Network Direct aware. Resultant benefits include very low latency metrics.

Learn more at http://blogs.msdn.com/philpenn and http://WindowsHPC.net.

Getting Started with Windows HPC Server 2008

philpenn — Thu, 15 Nov 2007 21:35:23 GMT

Beta1 of Windows HPC Server 2008 (aka Compute Cluster Server) has just been released (Nov 2007). The product consists of a unique Windows Server 2008 edition intended for deployment in compute intensive "Beowulf type" High Performance Computing clusters. Included are deployment, operations and scheduling services as well as libraries for development of "cluster aware" applications.

HPC is just one option for parallel computing solutions and specifically intended for localized high bandwidth, low-latency, deployments.

Please also see the following sites:

1. Windows HPC Community: http://WindowsHPC.net

2. My blog: http://blogs.msdn.com/philpenn

3. Product web: http://www.microsoft.com/hpc