Comment Feed for Channel 9 - 10-4 Episode 6: Parallel Extensions http://ecn.channel9.msdn.com/o9/previewImages/100/454583_100x75.jpg Channel 9 - 10-4 Episode 6: Parallel Extensions In this episode of 10-4, we start taking a look at Parallel Extensions to the .NET Framework. We'll look at some of the surface-area of the Parallel Extensions API and provide you with enough information to start working with it yourself in the Visual Studio 2010 CTP VPC. Remember that we are running these bits within a virtual machine with a single virtual processor, so you won't be able to see the performance improvements from the library. However, you will be able to start get a feel for the API itself. In future episodes, we will dive into deeper details of the various parts of Parallel Extensions. Also, in next week's episode, Jonathan Carter will be back to talk about another new feature in ASP.NET 4.0, so make sure to stay tuned for that! For more 10-4 episodes, be sure to visit: http://channel9.msdn.com/shows/10-4 Visual Studio Topic Area on Channel 9: http://channel9.msdn.com/VisualStudio Visual Studio 2010 CTP VPC: http://tinyurl.com/GetCTP Visual Studio 2010 Training Kit http://tinyurl.com/VS10Kit Concurrency MSDN Dev Center http://msdn.microsoft.com/concurrency 10-4! Over and out! en Tue, 21 May 2013 03:06:21 GMT Tue, 21 May 2013 03:06:21 GMT Rev9 Re: 10-4 Episode 6: Parallel Extensions posted by ViktorM

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633682943140000000 Fri, 23 Jan 2009 07:58:34 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633682943140000000 ViktorM Re: 10-4 Episode 6: Parallel Extensions posted by gzpbx

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633682990300000000 Fri, 23 Jan 2009 09:17:10 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633682990300000000 gzpbx Re: 10-4 Episode 6: Parallel Extensions posted by Yankee

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633682991220000000 Fri, 23 Jan 2009 09:18:42 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633682991220000000 Yankee Re: 10-4 Episode 6: Parallel Extensions
maybe gremlins has invaded the c9 servers :O that would also explain the scilence from the c9 team Wink

posted by aL_

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683000110000000 Fri, 23 Jan 2009 09:33:31 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683000110000000 aL_ Re: 10-4 Episode 6: Parallel Extensions What is going on here Smiley Just kidding. WMV (High) is working for me Smiley

posted by Vaso

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683049060000000 Fri, 23 Jan 2009 10:55:06 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683049060000000 Vaso Re: 10-4 Episode 6: Parallel Extensions
Maybe I missed it in the video, but if I got this right, the Parallel.For is the younger (and stronger Wink ) brother of C++ OpenMP ("#pragma omp parallel for"), right? Is there a difference between those two (besides the nice things like a ready-to-use ForEach) or is Parallel basically the .Net port of OpenMP?

posted by Raffo

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683071180000000 Fri, 23 Jan 2009 11:31:58 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683071180000000 Raffo Re: 10-4 Episode 6: Parallel Extensions
Thanks!

posted by Rhapsody

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683129530000000 Fri, 23 Jan 2009 13:09:13 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683129530000000 Rhapsody Re: 10-4 Episode 6: Parallel Extensions

posted by spivonious

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683243370000000 Fri, 23 Jan 2009 16:18:57 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683243370000000 spivonious Re: 10-4 Episode 6: Parallel Extensions posted by JasonOlson

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683264110000000 Fri, 23 Jan 2009 16:53:31 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683264110000000 JasonOlson Re: 10-4 Episode 6: Parallel Extensions
So, in short, it's a lot smarter than using Threads directly (as well as more rich and powerful). I'll go into some more details in the future on the work-stealing scheduler and just how this break down into tasks occurs. In the meantime, you can check out the link to the Concurrency MSDN Dev Center to get more information.

Hope this helps!

posted by JasonOlson

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683265940000000 Fri, 23 Jan 2009 16:56:34 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683265940000000 JasonOlson Re: 10-4 Episode 6: Parallel Extensions here.
C

posted by Charles

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683440160000000 Fri, 23 Jan 2009 21:46:56 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683440160000000 Charles Re: 10-4 Episode 6: Parallel Extensions posted by JasonOlson

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683555180000000 Sat, 24 Jan 2009 00:58:38 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633683555180000000 JasonOlson Re: 10-4 Episode 6: Parallel Extensions
If you only have code that uses the CPU oder memory it is the number of cores, but what does it when there are more IO operations.

1.) If you have got an application that does CPU calculation 50% of the time and 50% are IO operations like waiting for a another computer in a client/server situation. Then you could use 2 time the amount of cores. If you only have 10% CPU calculations and 90% IO (like a web server or another server application that is most time waiting for the user clients or user inputs). It would not be a good idea to only use 8 threads on a quad with two Quad Core Xeons. You could only have 8 users working on the server at a time. There you should use at least 100 threads.

2.) You could also have a program that calls another program (for example with the shell command and set wait to true). Then you cant know if it is a program that only waits for the user on another client to press the submit button or its an CPU intensive application like my multi core optimized audio encoder that is calling lame on several threads with different files. Then 100 threads would kill the computer if you do not have enough RAM. For the .NET Framework it is an IO operation but in reality it is a CPU only task.

3.) What does the class if you already have multiple threads and each thread does a parallel for loop (take another server where you created the connections with tcplistener.accepttcpclient and started each tcpclient in his own thread. If you have 16 cores and 32 client connections you would make too much connections again. Then you should only use 1 thread per client and if only 1 client is connected then you should use 16 threads.

4.) If I am using an application where the load is on an external network share. How does the .NET Framework know how man parallel operations can be done at once.

I think the parallel for is a good idea but it will never replace manual creation of threads.
Also debugging is more complicated. If I create the thread on my own I can give it a name and find it again very easy. When using network streams I set the threadname to ip and port number (127.0.0.1:4711).

posted by andrgin

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633684874610000000 Sun, 25 Jan 2009 13:37:41 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633684874610000000 andrgin Re: 10-4 Episode 6: Parallel Extensions
As far as debugging, the goal is to eliminate the need to debug at the thread level eventually (it obviously won't go away). We recently did a video with Daniel Moth where he shows some of the new debugging tools being integrated in Visual Studio 2010 for making debugging of parallel/concurrent applications easier. You can find it here: http://channel9.msdn.com/posts/VisualStudio/Debugging-Parallel-Applications-with-Visual-Studio-2010/.

As we have to write more and more concurrent applications, the debugging tools in Visual Studio need to be enhanced for this "new world", hence the efforts in the debugging tools space.

So, in short, yes, there is no current replacement for an experienced developer that intimately knows his application's needs for concurrency (usage patterns on the hardware, for instance). But if we can give that developer even more powerful abstractions to deal with and still meet his needs, it becomes very powerful indeed.

Thanks for watching!

posted by JasonOlson

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633685143580000000 Sun, 25 Jan 2009 21:05:58 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633685143580000000 JasonOlson Re: 10-4 Episode 6: Parallel Extensions

posted by esse

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633686530240000000 Tue, 27 Jan 2009 11:37:04 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633686530240000000 esse Re: 10-4 Episode 6: Parallel Extensions For simple Tasks where each one is doing different work (the same work with only different data is better done with a for each loop I think) the count cant be so big. If there are 20 threads running on a dual core machine this does not kill performance, only if 2K threads are running.

posted by andrgin2

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633686863530000000 Tue, 27 Jan 2009 20:52:33 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633686863530000000 andrgin2 Re: 10-4 Episode 6: Parallel Extensions
Most of the parallel operations you can perform with Parallel Extensions provide the ability to specify the "DegreeOfParallelism" which will handle this behavior. So if I was on a 8-core machine, but wanted to leave 2-cores for other work, I could specify a DegreeOfParallelism of 6. This is an easy way for the dev to "throttle" the application when he needs to.

If you need even more fine-grained control, there is a way to create your own TaskManager, not sure you want to go that way though.

posted by JasonOlson

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633687691510000000 Wed, 28 Jan 2009 19:52:31 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633687691510000000 JasonOlson Re: 10-4 Episode 6: Parallel Extensions        Since I'm an extermist VB guy, I converted your stunning demo in C# into VB code. How can I post it for VB fans here?

posted by VBCoder

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633770170010000000 Mon, 04 May 2009 06:56:41 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633770170010000000 VBCoder Re: 10-4 Episode 6: Parallel Extensions FYI you can't create a Task with Task.StartNew with beta 1 Smiley you need to use Task.Factory.StartNew Smiley

posted by yassir

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633788502480000000 Mon, 25 May 2009 12:10:48 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633788502480000000 yassir Re: 10-4 Episode 6: Parallel Extensions I'm very inexperienced with concurrency and parrallel anything, but I do use Background workers to run background tasks and then update my Win GUIs.  I'm just wondering if these new parrallel extentions with the Future and For classes add any advantages over using BackgroundWorkers?

Davey

posted by DFGasner

]]> http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633794740480000000 Mon, 01 Jun 2009 17:27:28 GMT http://channel9.msdn.com/Shows/10-4/10-4-Episode-6-Parallel-Extensions#c633794740480000000 DFGasner