Supercomputing and Affirmation

Oct. 27th, 2025 08:49 pm
tcpip: (Default)
[personal profile] tcpip
Every so often, there is a slight glimmer of light in my world where my usual state of driven dysthymia changes due to the affirming words and actions of others. Such an experience occurred last Friday when I organised a researcher tech talk with Dr Tomasz Wozniak, a senior lecturer in economics at UniMelb. Tomasz has recently been published, as part of an international team, in a Bank of Canada paper and in the prestiguous Journal of Econometrics on Structural Vector Autoregressions (SVARs) and time-series models that analyse the relationships between multiple economic variables to identify and isolate the effects of exogenous economic shocks. It's actually important stuff to keep people in jobs when (for example) there's a massive negative disruption to trade (hello, US tariffs).

Tomasz had been kind enough to provide a repository of his presentation, which also points out that in the course of his research and his use of Spartan he has become an editor of the R Journal and developed the R packages, bsvars, bsvarSIGNs, and bpvars. He had many extremely positive comments to make about Spartan, both in terms of the infrastructure that we offer and the support that we provide to researchers. Two comments particularly stood out; first was the effects of our optimisation of the software that we build from the source code, especially (in his case) the GNU compiler suite and the R programming language. As a result of our optimised installs, he reported that his jobs would run four times faster on Spartan compared to his own machine, despite the fact that he had faster processors. Further, he mentioned that a few years ago, after attending one of my introductory training sessions, he learned the advantages of using job arrays instead of a looping logic. Suddenly, his computational improvements were hundreds of times faster than what would be the case on his own system; we call it "high performance computing" for a reason.

This is hardly the first time that this has happened. For every dollar invested in high performance computing, the estimated social return on investment is $44 (in Japan, for example, it's c$75:1 due to alignment with national objectives). In a world where so many are in well-paid "bullshit jobs" whilst other struggle as part of the precariat class with low-paid insecure work, I have been fortunate enough to find a career that has stability and fair renumeration, interesting and challenging work, and actually produces socially useful outcomes. For almost twenty years, I have believed this with utter sincerity, but it is still very pleasing when the affirmation comes from others.

Database maintenance

Oct. 25th, 2025 08:42 am
mark: A photo of Mark kneeling on top of the Taal Volcano in the Philippines. It was a long hike. (Default)
[staff profile] mark posting in [site community profile] dw_maintenance

Good morning, afternoon, and evening!

We're doing some database and other light server maintenance this weekend (upgrading the version of MySQL we use in particular, but also probably doing some CDN work.)

I expect all of this to be pretty invisible except for some small "couple of minute" blips as we switch between machines, but there's a chance you will notice something untoward. I'll keep an eye on comments as per usual.

Ta for now!

Quality Experiences

Oct. 23rd, 2025 09:11 pm
tcpip: (Default)
[personal profile] tcpip
I have argued for a while that Epicureanism is a refinement of Hedonism and Stoicism is an advanced development from Epicureanism; "To live, to live well, to live better" (Whitehead, "The Function of Reason"). Each of these represents a qualitative change and, as one learns in the business of Quality Assurance, that is defined as improved precision and is differentiated as a continuum of accuracy, ultimately from "high quality" to "low quality". I find that this applies to people as well as processes; inconsistent people, who fluctuate between emotive extremes, can occasionally be enjoyable and exciting, but ultimately are hurtful and exhausting and are thus best avoided, no matter who is enticing the good times are. Such people invariably are unsuccessful in life; quality requires both a degree of consistency and reflective, tested, improvement.

Over the past few days, I have been fortunate enough in life to experience a few examples of high-quality experiences. The first was an evening of music, which I attended with Kate. This was headlined by the Paul Kidney Japanese Experience, and supported by The Black Heart Death Cult and Cat Crawl. All performed with great competence in accordance with their particular style. "Cat Crawl" (who describe themselves as "a three-piece tantrum in the form of a band") provided early 1980s-style feminist punk with humour, whilst in comparison "The Black Heart Death Cult" were a gloomy-shoegaze fusion, reminiscent of the French "blackgaze" from the 2000s. Finally, the Paul Kidney Japanese Experience gave something akin to a Japanese version an extended Hawkwind space rock concert. All in all, a great night with a great variety of styles. As a radical contrast, the following day Nitul invited me to the end-of-semester Baroque Ensemble Concert from the students at Unimelb's Faculty of Fine Arts and Music. It was an admirable selection from Lully, Bach, Vivaldi, Schein and more, and in total included over fifty performers of music and song. I found myself, as I often do in such music, drifting off to another world.

As more culinary experiences, Kate and I attended the Melbourne Italian Festival the following day at the Melbourne Exhibition Centre. The building is beautiful, but despite my heritage, I find a great deal of contemporary Italian culture pretty gaudy at best, especially in the field of fashion, homewares, and music. Of course, in food and film, it retains a very high level, the latter with a decidedly leftist influence. Apropos, last night I had the delight of being cooked for by the Minister for Climate Change Action and Energy Resources, etc, Lily D'Ambrosio, who provided an astounding Calabrian feast for some twenty individuals whilst showing off the capabilities of induction cookers. Lily deserves high praise for the quiet revolution she has led in Victoria, changing the production of electricity towards renewables and, more recently, with the phaseout of fossil fuels in domestic appliances, all with significant success. Quiet revolutions too, can be an example of quality.

AWS outage

Oct. 20th, 2025 10:11 am
alierak: (Default)
[personal profile] alierak posting in [site community profile] dw_maintenance
DW is seeing some issues due to today's Amazon outage. For right now it looks like the site is loading, but it may be slow. Some of our processes like notifications and journal search don't appear to be running and can't be started due to rate limiting or capacity issues. DW could go down later if Amazon isn't able to improve things soon, but our services should return to normal when Amazon has cleared up the outage.

Edit: all services are running as of 16:12 CDT, but there is definitely still a backlog of notifications to get through.

Edit 2: and at 18:20 CDT everything's been running normally for about the last hour.

Profile

crunch: (Default)
crunch

May 2009

S M T W T F S
     12
3456789
10111213141516
17181920212223
24252627282930
31      

Most Popular Tags

Style Credit

Expand Cut Tags

No cut tags
Page generated Nov. 1st, 2025 06:16 am
Powered by Dreamwidth Studios