GetWiki

{{Short description|Programming language}}

factoids

Rayon (Rust (programming language)>Rust library)HTTPS://GITHUB.COM/RAYON-RS/RAYON/BLOB/MASTER/FAQ.MD#HOW-DOES-RAYON-BALANCE-WORK-BETWEEN-THREADS>TITLE=RAYON FAQGITHUB >QUOTE=THE NAME RAYON IS A HOMAGE TO THAT WORK., | operating_system =| license =weblink}}| file_ext =}}

factoids

| typing = | implementations = | dialects = | influenced_by = | influenced = | operating_system = Unix-like, macOS| license = MITweblink}}| file_ext = }}{{Distinguish|SYCL}}

factoids

| typing =| implementations =| dialects =| influenced_by = | influenced =| operating_system =| license =| website = weblink" title="web.archive.org/web/20210117031010weblink"weblink| file_ext = (Same as C or C++)}}Cilk, Cilk++, Cilk Plus and OpenCilk are general-purpose programming languages designed for multithreaded parallel computing. They are based on the C and C++ programming languages, which they extend with constructs to express parallel loops and the fork–join idiom.Originally developed in the 1990s at the Massachusetts Institute of Technology (MIT) in the group of Charles E. Leiserson, Cilk was later commercialized as Cilk++ by a spinoff company, Cilk Arts. That company was subsequently acquired by Intel, which increased compatibility with existing C and C++ code, calling the result Cilk Plus. After Intel stopped supporting Cilk Plus in 2017, MIT is again developing Cilk in the form of OpenCilk.

History

MIT Cilk

The Cilk programming language grew out of three separate projects at the MIT Laboratory for Computer Science:WEB,weblink "A Brief History of Cilk, 2015-06-25, 2015-06-26,weblink dead,

• Theoretical work on scheduling multi-threaded applications.
• StarTech – a parallel chess program built to run on the Thinking Machines Corporation's Connection Machine model CM-5.
• PCM/Threaded-C – a C-based package for scheduling continuation-passing-style threads on the CM-5

In April 1994 the three projects were combined and christened "Cilk". The name Cilk is not an acronym, but an allusion to "nice threads" (silk) and the C programming language. The Cilk-1 compiler was released in September 1994.The original Cilk language was based on ANSI C, with the addition of Cilk-specific keywords to signal parallelism. When the Cilk keywords are removed from Cilk source code, the result should always be a valid C program, called the serial elision (or C elision) of the full Cilk program, with the same semantics as the Cilk program running on a single processor. Despite several similarities,{{which|date=September 2015}} Cilk is not directly related to AT&T Bell Labs' Concurrent C.Cilk was implemented as a translator to C, targeting the GNU C Compiler (GCC). The last version, Cilk 5.4.6, is available from the MIT Computer Science and Artificial Intelligence Laboratory (CSAIL), but is no longer supported.WEB,weblink The Cilk Project, 8 October 2010, 25 January 2016, MIT CSAIL, A showcase for Cilk's capabilities was the Cilkchess parallel chess-playing program, which won several computer chess prizes in the 1990s, including the 1996 Open Dutch Computer Chess Championship.JOURNAL, Leiserson, Charles E., Aske, Plaat, Programming parallel applications in Cilk, SIAM News, 31, 1998,weblink

Cilk Arts and Cilk++

Prior to {{circa|2006}}, the market for Cilk was restricted to high-performance computing. The emergence of multicore processors in mainstream computing meant that hundreds of millions of new parallel computers were being shipped every year. Cilk Arts was formed to capitalize on that opportunity: in 2006, Leiserson launched Cilk Arts to create and bring to market a modern version of Cilk that supports the commercial needs of an upcoming generation of programmers. The company closed a Series A venture financing round in October 2007, and its product, Cilk++ 1.0, shipped in December, 2008.Cilk++ differs from Cilk in several ways: support for C++, support for loops, and hyperobjects{{snd}} a new construct designed to solve data race problems created by parallel accesses to global variables. Cilk++ was proprietary software. Like its predecessor, it was implemented as a Cilk-to-C++ compiler. It supported the Microsoft and GNU compilers.

Intel Cilk Plus

On July 31, 2009, Cilk Arts announced on its web site that its products and engineering team were now part of Intel Corp. In early 2010, the Cilk website at www.cilk.com began redirecting to the Intel website (as of early 2017, the original Cilk website no longer resolves to a host). Intel and Cilk Arts integrated and advanced the technology further resulting in a September 2010 release of Intel Cilk Plus."Intel Flexes Parallel Programming Muscles" {{webarchive|url=https://web.archive.org/web/20100906030803weblink |date=2010-09-06 }}, HPCwire (2010-09-02). Retrieved on 2010-09-14."Parallel Studio 2011: Now We Know What Happened to Ct, Cilk++, and RapidMind" {{Webarchive|url=https://web.archive.org/web/20100926110843weblink |date=2010-09-26 }}, Dr. Dobb's Journal (2010-09-02). Retrieved on 2010-09-14. Cilk Plus adopts simplifications, proposed by Cilk Arts in Cilk++, to eliminate the need for several of the original Cilk keywords while adding the ability to spawn functions and to deal with variables involved in reduction operations. Cilk Plus differs from Cilk and Cilk++ by adding array extensions, being incorporated in a commercial compiler (from Intel), and compatibility with existing debuggers."Intel Cilk Plus: A quick, easy and reliable way to improve threaded performance", Intel. Retrieved on 2010-09-14.Cilk Plus was first implemented in the Intel C++ Compiler with the release of the Intel compiler in Intel Composer XE 2010.{{Citation needed|date=March 2015}} An open source (BSD-licensed) implementation was contributed by Intel to the GNU Compiler Collection (GCC), which shipped Cilk Plus support in version 4.9,"GCC 4.9 Release Series Changes, New Features, and Fixes", Free Software Foundation, Inc. Retrieved on 2014-06-29. except for the {{mono|_Cilk_for}} keyword, which was added in GCC 5.0. In February 2013, Intel announced a Clang fork with Cilk Plus support.Cilk Plus/LLVM The Intel Compiler, but not the open source implementations, comes with a race detector and a performance analyzer.Intel later discontinued it, recommending its users switch to instead using either OpenMP or Intel's own TBB library for their parallel programming needs.WEB,weblink Intel Cilk Plus is being deprecated, Hansang B., 20 September 2017, Intel Cilk Plus forum,

Differences between versions

In the original MIT Cilk implementation, the first Cilk keyword is in fact cilk, which identifies a function which is written in Cilk. Since Cilk procedures can call C procedures directly, but C procedures cannot directly call or spawn Cilk procedures, this keyword is needed to distinguish Cilk code from C code. Cilk Plus removes this restriction, as well as the cilk keyword, so C and C++ functions can call into Cilk Plus code and vice versa.

Deprecation of Cilk Plus

In May, 2017, GCC 7.1 was released and marked Cilk Plus support as deprecated.WEB,weblink GCC 7 Release Series. Changes, New Features, and Fixes, GCC, the GNU Compiler Collection, Intel itself announced in September 2017 that they would deprecate Cilk Plus with the 2018 release of the Intel Software Development Tools. In May 2018, GCC 8.1 was released with Cilk Plus support removed.WEB,weblink GCC 8 Release Series. Changes, New Features, and Fixes, GCC, the GNU Compiler Collection,

OpenCilk

After Cilk Plus support was deprecated by Intel, MIT has taken on the development of Cilk in the OpenCilk implementation, focusing on the LLVM/Clang fork now termed "Tapir".WEB, 2017-12-01, Cilk Hub taking on Cilk development after Intel announcement,weblink live, 2021-12-06, OpenCilk, en,weblink" title="web.archive.org/web/20180612204746weblink">weblink 2018-06-12, OpenCilk remains largely compatible with Intel Cilk Plus.WEB, OpenCilk,weblink 2021-12-06, OpenCilk, en, Its first stable version was released in March 2021.WEB, 2021-03-05, Release opencilk/v1.0 · OpenCilk/opencilk-project,weblink live, 2021-12-06, GitHub, en,weblink 2021-12-06,

Language features

The principle behind the design of the Cilk language is that the programmer should be responsible for exposing the parallelism, identifying elements that can safely be executed in parallel; it should then be left to the run-time environment, particularly the scheduler, to decide during execution how to actually divide the work between processors. It is because these responsibilities are separated that a Cilk program can run without rewriting on any number of processors, including one.

Task parallelism: spawn and sync

{{See also|Fork–join model}}Cilk's main addition to C are two keywords that together allow writing task-parallel programs.

• The {{mono|spawn}} keyword, when preceding a function call ({{mono|spawn f(x)}}), indicates that the function call ({{mono|f(x)}}) can safely run in parallel with the statements following it in the calling function. Note that the scheduler is not obligated to run this procedure in parallel; the keyword merely alerts the scheduler that it can do so.
• A {{mono|sync}} statement indicates that execution of the current function cannot proceed until all previously spawned function calls have completed. This is an example of a barrier method.

(In Cilk Plus, the keywords are spelled {{mono|_Cilk_spawn}} and {{mono|_Cilk_sync}}, or {{mono|cilk_spawn}} and {{mono|cilk_sync}} if the Cilk Plus headers are included.)Below is a recursive implementation of the Fibonacci function in Cilk, with parallel recursive calls, which demonstrates the {{mono|spawn}}, and {{mono|sync}} keywords. The original Cilk required any function using these to be annotated with the {{mono|cilk}} keyword, which is gone as of Cilk Plus. (Cilk program code is not numbered; the numbers have been added only to make the discussion easier to follow.)cilk int fib(int n) { < 2) {





}If this code was executed by a single processor to determine the value of {{mono|fib(2)}}, that processor would create a frame for {{mono|fib(2)}}, and execute lines 1 through 5. On line 6, it would create spaces in the frame to hold the values of {{mono|x}} and {{mono|y}}. On line 8, the processor would have to suspend the current frame, create a new frame to execute the procedure {{mono|fib(1)}}, execute the code of that frame until reaching a return statement, and then resume the {{mono|fib(2)}} frame with the value of fib(1) placed into {{mono|fib(2)}}'s {{mono|x}} variable. On the next line, it would need to suspend again to execute {{mono|fib(0)}} and place the result in {{mono|fib(2)}}'s {{mono|y}} variable.When the code is executed on a multiprocessor machine, however, execution proceeds differently. One processor starts the execution of {{mono|fib(2)}}; when it reaches line 8, however, the {{mono|spawn}} keyword modifying the call to {{mono|fib(n-1)}} tells the processor that it can safely give the job to a second processor: this second processor can create a frame for {{mono|fib(1)}}, execute its code, and store its result in {{mono|fib(2)}}'s frame when it finishes; the first processor continues executing the code of {{mono|fib(2)}} at the same time. A processor is not obligated to assign a spawned procedure elsewhere; if the machine only has two processors and the second is still busy on {{mono|fib(1)}} when the processor executing {{mono|fib(2)}} gets to the procedure call, the first processor will suspend {{mono|fib(2)}} and execute {{mono|fib(0)}} itself, as it would if it were the only processor. Of course, if another processor is available, then it will be called into service, and all three processors would be executing separate frames simultaneously.(The preceding description is not entirely accurate. Even though the common terminology for discussing Cilk refers to processors making the decision to spawn off work to other processors, it is actually the scheduler which assigns procedures to processors for execution, using a policy called work-stealing, described later.)If the processor executing {{mono|fib(2)}} were to execute line 13 before both of the other processors had completed their frames, it would generate an incorrect result or an error; {{mono|fib(2)}} would be trying to add the values stored in {{mono|x}} and {{mono|y}}, but one or both of those values would be missing. This is the purpose of the {{mono|sync}} keyword, which we see in line 11: it tells the processor executing a frame that it must suspend its own execution until all the procedure calls it has spawned off have returned. When {{mono|fib(2)}} is allowed to proceed past the {{mono|sync}} statement in line 11, it can only be because {{mono|fib(1)}} and {{mono|fib(0)}} have completed and placed their results in {{mono|x}} and {{mono|y}}, making it safe to perform calculations on those results.The code example above uses the syntax of Cilk-5. The original Cilk (Cilk-1) used a rather different syntax that required programming in an explicit continuation-passing style, and the Fibonacci examples looks as follows:CONFERENCE,weblink Cilk: An Efficient Multithreaded Runtime System, Robert D., Blumofe, Christopher F., Joerg, Bradley C., Kuszmaul, Charles E., Leiserson, Keith H., Randall, Yuli, Zhou, Proc. ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, Symp. Principles and Practice of Parallel Programming, 207–216, 1995, thread fib(cont int k, int n){ }thread sum(cont int k, int x, int y){ }Inside {{mono|fib}}'s recursive case, the {{mono|spawn_next}} keyword indicates the creation of a successor thread (as opposed to the child threads created by {{mono|spawn}}), which executes the {{mono|sum}} subroutine after waiting for the continuation variables {{mono|x}} and {{mono|y}} to be filled in by the recursive calls. The base case and {{mono|sum}} use a {{mono|send_argument(k, n)}} operation to set their continuation variable {{mono|k}} to the value of {{mono|n}}, effectively "returning" the value to the successor thread.

Inlets

The two remaining Cilk keywords are slightly more advanced, and concern the use of inlets. Ordinarily, when a Cilk procedure is spawned, it can return its results to the parent procedure only by putting those results in a variable in the parent's frame, as we assigned the results of our spawned procedure calls in the example to x and y.The alternative is to use an inlet. An inlet is a function internal to a Cilk procedure which handles the results of a spawned procedure call as they return. One major reason to use inlets is that all the inlets of a procedure are guaranteed to operate atomically with regards to each other and to the parent procedure, thus avoiding the bugs that could occur if the multiple returning procedures tried to update the same variables in the parent frame at the same time.

• The inlet keyword identifies a function defined within the procedure as an inlet.
• The abort keyword can only be used inside an inlet; it tells the scheduler that any other procedures that have been spawned off by the parent procedure can safely be aborted.

Inlets were removed when Cilk became Cilk++, and are not present in Cilk Plus.

Parallel loops

Cilk++ added an additional construct, the parallel loop, denoted {{mono|cilk_for}} in Cilk Plus. These loops look likevoid loop(int *a, int n){ }This implements the parallel map idiom: the body of the loop, here a call to {{mono|f}} followed by an assignment to the array {{mono|a}}, is executed for each value of {{mono|i}} from zero to {{mono|n}} in an indeterminate order. The optional "grain size" pragma determines the coarsening: any sub-array of one hundred or fewer elements is processed sequentially. Although the Cilk specification does not specify the exact behavior of the construct, the typical implementation is a divide-and-conquer recursion,WEB, Compilers and More: The Past, Present and Future of Parallel Loops, Michael, Wolfe, 6 April 2015, HPCwire,weblink as if the programmer had writtenstatic void recursion(int *a, int start, int end){