Machine Learning for Critical Workflows | Part III

Critical-Workflows-Blog-Part3

(This is the third and last blog entry in a series of three. The first one introduced big data analytics and critical workflows. The second post discussed critical workflows in oil and gas and in life sciences. This one will speculate about machine learning techniques to optimize such workflows.) Machine learning (ML), at first blush, has to be one of the lesser Olympians in today’s IT pantheon: a quick Google search reveals “big data” to be Zeus (863 million entries), closely followed by “analytics” (632 million), while “cloud computing” is trailing at 161 million entries, and machine learning a distant fourth at 59 million entries. ML is typically defined as those algorithms (and the study thereof) that can discover patterns in data ... [ Read More ]

From Grand Challenge Applications to Critical Workflows for Exascale | Part II

Grand-Challenge-Blog-Part2-Critical-Workflows

(This is the second in a series of three blog entries. The first post introduced big data analytics and critical workflows, this one will discuss critical workflows in oil and gas and in the life sciences, and the last will speculate about machine learning techniques to optimize such workflows). In the first post, I defined workflows in terms of a low-attack surface which implied four characteristics: many user input fields, combined with mixed protocols and interfaces and blocks of software functionalities that are organized as a service to each other. In addition, critical workflows are those without which R&D or engineering doesn’t get done. I also gave an example of big data analytics (BDA) and noted an article on the analysis of ... [ Read More ]

HPC Software Optimization Trends (Part 2): What Will the Future Be Like and How Do We Prepare for It?

Software-Blog-Image-Part2

To what extent do past and current HPC software optimization activities predict the future? Current optimization trends and next-gen hardware designs point to more threads, wider vectors, and an increasingly complex memory hierarchy. Is HPC application software ready for the future foretold by this trajectory? What will it be like and how can you be prepared for it? Where did we come from and where are we now? For background about how we arrived at the current state of HPC software optimization, read part one of this blog series: “HPC Software Optimization Trends (Part 1): Where Did We Come From and Where Are We Now?” The key point is to realize that the recent past of HPC software optimization has been marked by relatively long ... [ Read More ]

HPC Software Optimization Trends (Part 1): Where Did We Come From and Where Are We Now?

Software-Blog-Image

To describe the current trajectory of software optimization trends in HPC, we need to understand our recent past. Which recent trends dictate our current state? We also need to know where we are now. Which HPC software optimizations are currently commonplace? Finally, to what extent does the trajectory created by past and current HPC software optimization activities predict the future? Where did we come from? We’ll start our software optimization narrative by talking about two hardware trends: Moore’s law (the number of transistors in an integrated circuit doubles approximately every two years); and Dennard scaling (as transistors get smaller their power density stays constant). Moore’s law, providing smaller transistors coupled with ... [ Read More ]

Chapel Users ‘CHIUW’ Their Way Through Portland

Chapel-Blog

A few dozen Chapel enthusiasts recently devoted a weekend to CHIUW 2015 — the second annual Chapel Implementers and Users Workshop. CHIUW (pronounced “chew”) is a forum for developers and practitioners of the Chapel parallel programming language to meet and share results while strategizing about the language’s future. This year’s workshop was held in Portland, Oregon, as part of the 36th annual ACM SIGPLAN conference on Programming Language Design and Implementation (PLDI). Between events, attendees made good on the CHIUW name by taking advantage of Portland’s food scene at Frank’s Noodle House, the Red Star, Blossoming Lotus, Burnside Brewing Company, Salt and Straw, Voodoo Doughnuts (natch) and Tilt (get the pie shake!). CHIUW 2015 was ... [ Read More ]