Comparing Parallel Functional Array Languages: Programming and Performance

91•vok•4mo ago

Comments

yubblegum•4mo ago

Chapel got a mention in the 'Related Work' section. I looked at it a few years ago and found it compelling (but I don't do HPC so it was just window watching). What's the HN feedback on Chapel?

https://chapel-lang.org/

marai2•4mo ago

If you scroll down on the Chapel-lang website, there seems to be a lot of activity happening with this language. There is even going to be a ChapelCon 2025.

https://chapel-lang.org/blog/posts/chapelcon25-announcement/

throwaway17_17•4mo ago

Chapel and Lustre (a parallel, distributed file system) from Cray were funded by DARPA’s High Productivity Computing Systems program. This work, along with Fortress, from Sun, were developed explicitly to enable and ‘simplify’ the programming of distributed “supercomputers”. The work and artifacts, along with the published documentation and research is of particularly high quality.

Even if you aren’t involved in HPC I’d say the concepts transfer or provide a great basis for parallel and distributed idioms and methodologies that can be adapted to existing languages or used in development of new languages.

TL;DR - Chapel is cool and if you are interested in the general subject matter (despite a different focus) Fortress, which is discontinued, should also be checked out.

bradcray•4mo ago

@yubblegum: I'm unfairly biased towards Chapel (positively), so won't try to characterize HN's opinion on it. But I did want to note that while Chapel's original and main reason for being is HPC, now that everyone lives in a parallel-computing world, users also benefits from using Chapel in desktop environments where they want to do multicore and/or GPU programming. One such example is covered in this interview with an atmospheric science researcher for whom it has replaced Python as his go-to desktop language: https://chapel-lang.org/blog/posts/7qs-dias/

yubblegum•3mo ago

Thank you Brad! I was in fact wondering about GPU use myself. Does it work with Apple's M# GPUs?

Btw, I was looking at the docs for GPU [1] and unsolicited feedback from a potential user is that the setup process needs to become less painful. For example, yesterday installed it via brew but then hit the setup page for GPU and noted I now needed to build from source.

(Back in the day, one reason some of Sun's Java efforts to extend Java's fieddom faltered was because of the friction of setup for (iirc) things like Applets, etc. I think Chapel deserves a far wider audiance.)

[1]: https://chapel-lang.org/docs/technotes/gpu.html#setup (for others - you obviously know the link /g)

p.s. just saw your comment from last year - dropping it here for others: https://news.ycombinator.com/item?id=39032481

bradcray•3mo ago

@yubblegum: I'm afraid we don't have an update on support for Apple GPUs since last year's comment. While it comes up from time-to-time, nobody has opened an issue for it yet (please feel encouraged to!), and it isn't something we've had the chance to prioritize, where a lot of our recent work has focused on improving tooling support and addressing user requests.

I'll take your feedback about simplifying GPU-based installs back to our team, and have noted it on this thematically related issue: https://github.com/chapel-lang/chapel/issues/25187#issuecomm...

munchler•4mo ago

Are these languages pure in the functional sense? E.g. Do they allow/encourage mutation? My understanding is that APL permits mutable state and side effects, but maybe they are rarely used in practice? If you're modifying the contents of an array in-place, I don't think it's reasonable to consider that functional.

zfnmxt•4mo ago

Futhark, SaC, and Accelerate have purely functional semantics. Futhark has something called "in-place updates" that operationally mutate the given array, but semantically they work as if a new array is created (and are statically guaranteed to work this way by the type system).

RodgerTheGreat•4mo ago

APL arrays are values in the same sense as value types in any functional language. You don't explicitly modify arrays in-place; if they happen to have a refcount of 1 operations may happen in-place as an optimization, but not in a manner which observably alters program behavior.

grg0•4mo ago

Accelerate is a Haskell library/eDSL.

axman6•4mo ago

I wasn’t expecting to personally know two of the authors, but having Accelerate included makes sense.

geocar•4mo ago

> My understanding is that APL permits mutable state and side effects ... If you're modifying the contents of an array in-place, I don't think it's reasonable to consider that functional.

      a←'hello'
      a[1]←'c'

This does _not_ modify the array in-place. It's actually the same as:

     a←'hello'
     a←'c'@1⊢a

which is more obviously functional. It is easy to convince yourself of this:

      a←'hello'
      b←a
      b[1]←'j'
      a,b

returns 'hellojello' and not 'jellojello'.

teleforce•4mo ago

Notice that all the all the languages mentioned depends on the external BLAS library for example OpenBLAS for performance.

D language have excellent support functional and array features with parallel support. On top that not known to others it has high performance native BLAS kind of library with ergonomic and intuitiveness similar to python [1].

[1] Numeric age for D: Mir GLAS is faster than OpenBLAS and Eigen (2016):

http://blog.mir.dlang.io/glas/benchmark/openblas/2016/09/23/...

zfnmxt•4mo ago

> Notice that all the all the languages mentioned depends on the external BLAS library for example OpenBLAS for performance.

That's incorrect. Futhark doesn't even have linear algebra primitives---everything has to be done in terms of map/reduce/etc: https://github.com/diku-dk/linalg/blob/master/lib/github.com...

tomsmeding•4mo ago

The same holds for Accelerate, and I'm fairly sure also SaC and APL. DaCe even gets a special mention in the paper in section 10.5 stating that they specifically _do_ use BLAS bindings.

joe_the_user•4mo ago

"Notice that all the all the languages mentioned depends on the external BLAS library". I didn't notice this 'cause I don't think it's true. For example, it highly implausible that APL[1] would depend on BLAS[2] considering APL predates BLAS by 5-10 years ("developed in the sixties" versus "between 1971 and 1973"). I don't think Futhark uses BLAS either but in modern stupidity, this currently two hour old parent has taken over Google results so it's hard to find references.

[1] https://en.wikipedia.org/wiki/APL_(programming_language)

[2] https://en.wikipedia.org/wiki/Basic_Linear_Algebra_Subprogra...

DrNosferatu•4mo ago

Matlab supposedly is “portable APL”.

DrNosferatu•4mo ago

the man who invented MATLAB, Cleve Moler said: [I’ve] always seen MATLAB as “portable APL”. [1]

…why the downvoting?

[1] - https://computinged.wordpress.com/2012/06/14/matlab-and-apl-...

beagle3•4mo ago

I didn't downvote, but ... as someone who used both, this statement seems nonsensical.

APL is mathematical notation that is also executable. It is all about putting a mathematical algorithm in a succinct, terse way.

MATLAB is a clunky Fortran-like language that does simple 2D matrix stuff reasonably terse (though not remotely as terse as APL), and does everything else horribly awkwardly and verbosely.

Modern MATLAB might be comparable to 1960s APL, but original MATLAB was most certainly not, and even modern MATLAB isn't comparable to modern APL (and its successors such as BQN and K)

devlovstad•4mo ago

I took a course on massively parallel programming taught by one of the authors of this paper that extensively used Futhark and CUDA. While I have not used any of these languages since, I have used JAX[1] quite a lot, where the learnings from this course have been quite helpful. Many people will end up writing code for GPUs through different levels of abstraction, but those who are able to reason about the semantics through functional primitives might have an easier time understanding what's happening under the hood.

vanderZwan•4mo ago

I think the intended footnote was accidentally left out. Were you talking about this Python library?

https://docs.jax.dev/en/latest/index.html

tough•4mo ago

There's a JAX for AI/LM too

https://github.com/jax-ml/jax

but yeah no idea which the OP meant

zfnmxt•4mo ago

> I took a course on massively parallel programming taught by one of the authors of this paper that extensively used Futhark and CUDA.

PMPH? :)

GNU Midnight Commander

Notion API importer, with Databases to Bases conversion bounty

The Asus Gaming Laptop ACPI Firmware Bug: A Deep Technical Investigation

Shai-Hulud malware attack: Tinycolor and over 40 NPM packages compromised

I just want an 80×25 console, but that's no longer possible

Things you can do with a Software Defined Radio (2024)

Murex – An intuitive and content aware shell for a modern command line

In Praise of Idleness (1932)

How to make the Framework Desktop run even quieter

Doom crash after 2.5 years of real-world runtime confirmed on real hardware

Denmark close to wiping out cancer-causing HPV strains after vaccine roll-out

About the security content of iOS 15.8.5 and iPadOS 15.8.5

I got the highest score on ARC-AGI again swapping Python for English

A dumb introduction to z3

AMD Open Source Driver for Vulkan project is discontinued

CubeSats are fascinating learning tools for space

Waymo has received our pilot permit allowing for commercial operations at SFO

Show HN: A PSX/DOS style 3D game written in Rust with a custom software renderer

Irssi: IRC Client in a Docker Image

I built my own phone because innovation is sad rn [video]

Slow social media

Tuberculosis shaped Victorian fashion (2016)

Meta RayBan AR glasses shows Lumus waveguide structures in leaked video

Should we drain the Everglades?

In Defense of C++

Bertrand Russell to Oswald Mosley (1962)

How Container Filesystem Works: Building a Docker-Like Container from Scratch

Launch HN: Rowboat (YC S24) – Open-source IDE for multi-agent systems

Global Peace Index 2025

Wait4X allows you to wait for a port or a service to enter the requested state

GNU Midnight Commander

Notion API importer, with Databases to Bases conversion bounty

The Asus Gaming Laptop ACPI Firmware Bug: A Deep Technical Investigation

Shai-Hulud malware attack: Tinycolor and over 40 NPM packages compromised

I just want an 80×25 console, but that's no longer possible

Things you can do with a Software Defined Radio (2024)

Murex – An intuitive and content aware shell for a modern command line

In Praise of Idleness (1932)

How to make the Framework Desktop run even quieter

Doom crash after 2.5 years of real-world runtime confirmed on real hardware

Denmark close to wiping out cancer-causing HPV strains after vaccine roll-out

About the security content of iOS 15.8.5 and iPadOS 15.8.5

I got the highest score on ARC-AGI again swapping Python for English

A dumb introduction to z3

AMD Open Source Driver for Vulkan project is discontinued

CubeSats are fascinating learning tools for space

Waymo has received our pilot permit allowing for commercial operations at SFO

Show HN: A PSX/DOS style 3D game written in Rust with a custom software renderer

Irssi: IRC Client in a Docker Image

I built my own phone because innovation is sad rn [video]

Slow social media

Tuberculosis shaped Victorian fashion (2016)

Meta RayBan AR glasses shows Lumus waveguide structures in leaked video

Should we drain the Everglades?

In Defense of C++

Bertrand Russell to Oswald Mosley (1962)

How Container Filesystem Works: Building a Docker-Like Container from Scratch

Launch HN: Rowboat (YC S24) – Open-source IDE for multi-agent systems

Global Peace Index 2025

Wait4X allows you to wait for a port or a service to enter the requested state

Comparing Parallel Functional Array Languages: Programming and Performance

Comments