Transform 2021 rolled out

On Friday we wrapped up the 2021 edition of TRANSFORM, the Software Underground’s annual virtual conference. We stuffed a hackathon, 21 tutorials, 20 lightning talks, and an annual general meeting into a week-long celebration of open subsurface code and data.

Many thanks to our sponsors — especially Studio X in Austin, Texas — and to all of the participants who donated to the conference this year. As a pay-what-you-like event, we depend on generosity to fund the things we do. In return, we are trying to bring some new superpowers to the community. So far, so good.

Just like last year, the event kicked off with a hackathon, which again lasted all week. The event saw 9 projects being worked on. this number included long-lived projects like Subsurface, GemGIS, SEGY-SAK and Striplogm as well as new projects looking at seismic footprint removal and well correlation, among other things. We’ll tell you all about these projects in the coming days.

The heart of the conference week itself was the 21 amazing tutorials — 33% more than we had in 2020! The instructors and presenters this year participated from all over the world:

The 29 instructors and 20 presenters this year came from all over the world.

We’re so fortunate to have scientists in our community that not only spend hours (years!) writing open source software for others to use, but then will also contribute open content to help others use it. Many, many thanks to our team of instructors:

Day 1: Ashley Russell (NOR), Claire Veillard (NOR), Florian Wagner et al (DEU), Anne Estoppey (NOR), Miguel de la Varga (DEU), Diana Acero-Allard (USA), Maria Cecilia Bravo (NOR), Michael Pyrcz (USA), Thomas Martin (USA).

Day 2: Tony Hallam (GBR), Lachlan Grose & Mark Jessop (AUS), Olawale Ibrahim (NGA), Øystein Klemetsdal (NOR), Nathaniel Jones (USA), Bane Sullivan (USA), Seogi Kang (USA).

Day 3: Jørgen Kvalsvik (NOR), Graeme Mackenzie (NOR), Edward Caunt (GBR), Steve Purves (ESP), Matteo Ravasi (SAU), Dewey Dunnington (CAN), Santi Soler (ARG), Irene Wallis (NZL), Katie McLean (NZL).

It wasn’t all Python either — one tutorial used R, another MATLAB/Octave — and we even had a tutorial in Spanish this year. We also had participants from well outside the usual petroleum-rich industries: geothermal, mining, hydrology, and technology were all represented. I hope we continue to see increased diversity in languages, industries, location, and in all dimensions.

The best thing of all, especially if you weren’t able to take part last week? Everything is on YouTube, so check it out, follow along, and learn some new tricks.

One of the really remarkable things this year was the prevalence of tutorials and hackathon projects that combined multiple software projects from the open subsurface stack (which was the goal of TRANSFORM all along). Several events combined two or more of GemPy, Devito, PyVista, Subsurface, segyio/SEGYSAK, or lasio/welly/striplog. It’s exciting and encouraging to see, and signals a new level of maturity among these tools. The future for the open subsurface stack looks bright.

Thank you to the organizing team — Dieter Werthmuller, Ashley Russell, Irene Wallis, Brendon Hall, Rob Leckenby and Sofiyah Mokhtar — for helping pull everything together.

And thank you to everyone that participated in TRANSFORM 2021. I hope you learned something new, and met someone interesting. Please tell your friends and come back next year!

TRANSFORM 2021 is coming

Mark your calendar: 16 to 23 April. The virtual conference for the digital subsurface is returning, a little earlier this year, so that it can incorporate the Annual General Meeting of the Software Underground on Wednesday 21 April. It will be a rather momentous occasion, because it is the first AGM since we incorporated the society last spring. Please come and help us celebrate — and determine the future of this organization!

If you just want to get to the sign-up, click the button. If you want to learn more, read on!

As last year, the conference will focus on expanding the horizons of our members. This means helping people acquire new skills, meet new people, and find out about new problems in applied subsurface science and engineering. Here’s how the schedule looks from a very high level:

An outline schedule for TRANSFORM 2021. We will publish the timing of these blocks in the near future. For now, it’s just a guide and is subject to change.

You may not have encountered some of these components before, especially not in a virtual world, so here’s a bit more detail:

• Hackathon — Teams of up to about 8 collaborate on all sorts of projects, from Python libraries to open data to reproducing papers. Check out the report part one and part two from last year.

• Tutorials — Get started on a new tool or skill! These 2-hour sessions will be 100% hands-on and can be consumed live or at your own pace. Check out the TRANSFORM 20 lessons.

• Unconference — This is the bit of the conference where we tackle the big questions. We’ll announce these components as we get closer to the event.

• Birds of a Feather (BOF) — Software Underground aims to be a platform to elevate other communities and projects. BOFs are where people with big ideas in common flock together.

• Annual General Meeting (AGM) — The Underground incorporated in April. Our first AGM will see our first elections and voting on our constitution. You’re invited, please sign up here.

• Lightning talks — Five minutes is not long, but it’s long enough to get a crowd stoked about your latest project or keenest insight! Watch the lightning bolts from Day 1 and Day 2 last year.

TRANSFORM 2020 brought over 700 digital subsurface professionals together to talk and learn about their craft. The virtual format means anyone can join us, wherever they are. And our Pay What You Like fee means that cost is never an issue. If you are planning to join us, sign up now and we’ll make sure you’re kept up to date.

---

💡 If your organization would like to sponsor TRANSFORM 2021 and grow the learning opportunities for scientists in our field, we’d love to hear from you! Find out more about supporting our programs.

Tech for online meetings

In pulling TRANSFORM 2020 together, the organizers (Filippo Broggini, Brendon Hall, Rob LEckenby, Victoria-Lou Devezes, and me) looked at a lot of technology options. I thought I’d share the stuff we used here, in case you’re wondering what you need for a full-on virtual conference. But first, I’ll try to give a high-level description of the sorts of events we hosted at the conference.

---

We had three main types of session to support:

Tutorials

We hosted 14 three-hour tutorials, which mostly involved one or two instructors and 10 to 150 learners. Behind the scenes, there was one ‘livestream host’, who was essentially like a TV director.

The instructors were in a Zoom meeting with the host, sharing screens with them. The host captured their Zoom meeting with OBS Studio, and streamed it to YouTube Live. All of the participants watched via YouTube, and the live stream is also preserved there.

Lightning talks

There were two lightning talk sessions, each two hours long. The set-up was similar to the tutorials, except that there were more presenters — 12 per session. They came into the Zoom just before their allotted time and left right after, so there were never more than 3 or 4 people in the Zoom at once.

Unsessions

These were not streamed to YouTube, so we were able to host everyone in one big Zoom meeting. (I had a Large Meeting add-on ‘just in case’ but we didn’t need it in the end; the most we had was 97 people.) This made the session susceptible to Zoom-bombing, so we were careful about where we shared the link, and we used a waiting room — with Victoria ‘on the door’ to let people in promptly.

The unsession format, which I’ll write about another time, relied heavily on Zoom’s breakout rooms. We also used GroupMap a lot — it’s a great tool for capturing ideas from a group of people.

---

Here are the tools we used:

• Slack — the heart and mind of the Software Underground already lives in our Slack workspace. To make the multiple conversations more manageable, we made channels for all of the sessions and hackathon projects, and this worked well. During the week, 700 active members exchanged about 19,000 messages, about 50% of which were in private chat.

• Zoom — the Covid-famous video conferencing tool. It worked well for us for the host–presenter meetings in the tutorials and lightning talks, and as the main room for the unsessions and hackathon presentations. We were very worried about Zoom-bombing, and were perhaps over-cautious (some legit people found it hard to enter sessions).

• YouTube — for the tutorials and lightning talks, we streamed the host–presenter Zoom to YouTube for participants to consume. This has a few big advantages: it eliminates the Zoom-bombing risk, participants can pause and rewind the live stream, and videos go straight to YouTube afterwards. And it’s free!

• OBS Studio — a fantastic open-source tool that lets you combine images, video feeds, and audio sources into a single stream, which you can send to YouTube (or Twitch or any other streaming service). This is how we streamed the Zoom sessions. It does have a learning curve though, and certainly requires an off-screen ‘director’ to manage it all — and several practice sessions to get the workflow down.

• GitHub — is indispensable for code-sharing and source control. I think all of the hackathon projects hosted their repos on GitHub. The tool is not intuitive for new programmers though, and wrangling git and GitHub is one of the most requested help topics in our hackathons and courses.

• GroupMap — a wonderful tool for collaborative brainstorming. It definitely needs a couple of hours to get the hang of what it can do, but for me this was the standout discovery of the event. Its best feature is that you can set up a workflow, like Survey > Brainstorm > Vote > Results and then guide the group through the stages, live.

• Sched and Eventbrite — for event registration. Both of these tools have their high-points — Sched is really nice for building the event schedule — but the registration process for the event was a bit of a hairball and while these tools are supposed to play nicely together, I never felt comfortable with either of them.

• Printful — a T-shirt (and other merch) vendor. The advantages are that they print ‘direct to garment’ (i.e. there’s no setup, they just print a shirt when you order one), they take care of fulfilment, and their system works seamlessly (sort of) with Squarespace, our website host. But the system is not that easy to use and I’m thinking of switching to Teespring.

• We also used a bit of hardware. Microphones were hard to find during the Covid-19 crisis, but we sent Blue Yeti Nano or Blue Snowball Ice USB mics to our instructors. The Yeti Nano is especially nice, with two pickup patterns and a hardware mute button.

• Other… The organizers and the participants used other tools during the conference, including: Mentimeter, Google Maps, Miro, and HackMD, plus of course Twitter and other social media.

---

I don’t think I appreciated it before the event — looking back, it seems obvious — but technology is completely intertwined with an online-first event. Sometimes the limitations of the tool force you to adapt; other times, the tool can enable new things you hadn’t thought of. It’s going to be interesting watching these remote collaboration tools evolve over the coming months and years. And even more interesting thinking about what kinds of meetings we can have with them!

If you have a favourite collaboration tool I haven’t mentioned here, or you’ve been in a meeting that did something different, I’d love to hear about it.

TRANSFORM 2020

We did it! Surrounded by sawdust from the recent incorporation of the Software Underground as a non-profit, we emerged from the wreckage of the Covid-cancelled hackathons in Amsterdam and Houston. Not just alive, but full of vigour and hope for the new world of online scientific events. And everything — well, almost everything — worked out.

Before saying anything more, a huge Thank You to our sponsors for making our events possible. And a special mention for DELL Technologies, who have been an unflinching supporter of the Software Underground and Agile’s community events for years.

The audacious plan

Initially, our purpose was to move the cancelled hackathons online. So from 6 June to 14 June, Filippo Broggini and others hosted a 9-day hackathon. This worked so fantastically well that I don’t think it’s an exaggeration to say it was the most successful subsurface hackathon ever. But I’ll leave Filippo to tell you all about it in the coming days.

Our next thought was, “Let’s help people skill up and add some tutorials.” So Brendon Hall, Rob Leckenby and I hosted 14 completely free and fully interactive two- to three-hour tutorials during the week. All of these streamed direct to YouTube and will stay there forever (see links below).

Then we added two group-participation unsessions — one on geoscience careers, and one on open source tools — and two sets of lightning talks from anyone who wanted to give one. All of this while several of the hackathon projects were still in full swing. It was a hectic week!

The tutorials

Fair warning: there is about 37 hours of first-rate instruction in digital earth science here. The first two are totally approachable for beginners, (and there's no shortage of people in the Software Underground who can help you get started!) so there's truly something for everyone.

• Getting started with Python — Robert Leckenby — Video — Repo

• Using Python subsurface tools — Thomas Martin — Video — Repo

• Open-source spatial data analytics with GeostatsPy — Michael Pyrcz — Video — Repo

• Geological modeling with GemPy — Miguel de la Varga — Video — Repo

• Digital subsurface data loaders — Jørgen Kvalsvik — Video — Repo

• Geophysical Inversion in SimPEG — Lindsey Heagy — Video — Repo

• Geologic image processing with Python — Joe Kington — Video — Repo

• Intro to interactive visualization in Jupyter for well data — Ashley Russell — Video — Repo

• Geophysical modeling with Devito — Rhodri Nelson — Video — Repo

• From scattered data to gridded products using Verde — Leonardo Uieda — Video — Repo

• Scalable and resilient systems architecture — Liz Dennett — Video — Repo

• Scalable model training with Ray Tune — Steve Purves — Video — Repo

• Geospatial analysis in Python — Martin Bentley — Video — Repo

• Idea to MVP (web apps for scientists) — Matt Hall & Brendon Hall — Video — Repo

• On-demand seismic processing with AWS — Constantine Vavourak — Video — Repo

A huge Thank You to all of the instrutors, who not only gave freely of their time and insight, but also are all using open code and open data. No paywalls here!

---

Lightning talks

I'm so glad we added these 24 five-minute talks to the schedule. It was no trouble filling them — people signed themselves up. Every single talk was enlightening in some way, and these sessions were both really fun to be in. Thank you to everyone who took part!

• Lightning talks, Day 1

• Lightning talks, Day 2

Here's Andrea Balza Morales talking about the GeoLatinas Coding Group, which meets on Zoom twice a week:

---

The unsessions

An 'unsession' is a scientific meeting session, but without talks. Instead, we have a group discussion — but not the painful sort where you pass a mic around. We have a discussion that involves every scientist in the room. Since holding the first geoscience 'unsession' at CSEG in 2013, we've continued to evolve and adapt the methodology, but Monday was the first time I've tried to do one online.

I'll write more about these unsessions in the coming days, but here's a high-level description of what happened:

• Unsession 1: What is good career advice in 2020? Around 95 people showed up to the start of this conversation about jobs and skills. We shared our career paths so far, and groups chatted about the best — and worst! — job-related advice they'd received. Finally we identified and ranked ideas for tools the Software Underground could build to help us all help each other find work we love.

• Unsession 2: What open tools are needed now? The second session had around 55 people in conversation around open source tools. We talked about our favourite pieces of software, and what subsurface-flavoured versions might look like. And we heard how 4 current projects are trying to fill gaps in our current workflows, for example in seismic data management, and between geological models and GIS.

Here's where participants in the unsessions on Monday (blue) and Tuesday (red) were located:

---

On Wednesday we cleared our schedule in support of the #ShutDownSTEM and #strike4blacklives activism. We did this to help shine a light on the fact that black and racialized people everywhere are systematically disadvantaged in academia, industry, government, and all avenues in which STEM is practiced. In place of our schedule,we individually used the day to educate ourselves and listen to black voices in STEM. We must do better.

If you have not already done so, I urge you to read and sign this petition, which seeks to directly address the diversity problem we face today in geoscience.

---

If you took part in Transform 2020 — we thank you for your participation, and hope you learned something and will tell your friends and return next time.

We’ll write more soon about Transform 2020, which I hope and believe will have ramifications for how this community collaborates in the future. So stay tuned for that.

#ShutDownSTEM at TRANSFORM

In support of #ShutDownSTEM, #strike4blacklives and the anti-racism movement, we are shutting down TRANSFORM and the Software Underground on Wednesday 10 June, and clearing Wednesday's conference schedule.

The TRANSFORM 2020 virtual conference is officially underway. But as you know, there is a great deal of unrest in the world at the moment, particularly around the issue of racism and especially anti-black racism. The Software Underground has stated that we would do more to fight racism in earth science, and to strive to be the most diverse, inclusive community we can be.

On Friday, black academics in astronomy proposed action: a strike in science and technology of at least 1 day — Wednesday 10 June — in support of Black Lives Matter and the anti-racism movement. Please read this call to action: https://www.particlesforjustice.org/

It ends like this:

we call on people who are not Black to spend a day undertaking discussion and action that furthers this work, while providing Black scientists with a day of rest. Every single institution around the world can and should get involved in this work, and the strike marks an opportunity to recommit to the humanist values which should underpin academic work, including the belief that Black Lives Matter.

This, in turn, led to the #ShutDownSTEM action on Wednesday, which you can also read about via the Twitter hashtag.

There is also currently an open petition drawing attention to the same injustice, but in geoscience: Call for a Robust Anti-Racism Plan for The Geosciences (https://www.change.org/p/geoscientists-call-for-a-robust-anti-racism-plan-for-the-geosciences). This is the core of that document:

we humbly but firmly demand all geoscience societies and organizations take concrete action against racism – particularly the anti-Black racism that plagues our community – because written and/or oral denouncement does not go far enough.

This is more than just a petition, it is a call to clear, accountable action. It sets out what we can do, as individual scientists and as a society, to fight systemic racism in our field and beyond. Please consider signing it.

As for the events we had planned for Wednesday, we are still figuring out the new schedule. Wednesday's content will move to other days. The conversations will pick up again on Thursday. Then, over the coming months, we will find ways to act and make a difference. As part of our ambition to be a better and more inclusive society, we will plan events to discuss diversity, equity, inclusion, access, and justice.