Big data supercomputing simplified by 800 lines of code
Scientists have developed "
"Big Data analysis projects need to use different frameworks, which often have dependencies that differ from what we have already on the supercomputer,"
"So, we've developed a lightweight 'container' approach that lets users package their own user defined software stack in isolation from the host operating system," he added.
Users can thus add required packages as images to run their programmes on the supercomputer without having to reconfigure the system.
This maintains a "convenience bubble" of administrative freedom while protecting the security of the larger system.
Charliecloud was built following two bedrock principles of computing, that of least privilege and the Unix philosophy to "make each program do one thing well."
Competing products range from 4,000 to over 100,000 lines of code.