Prof. Stefan Güttel awarded a Royal Society Industry Fellowship

The Industry Fellowship of the Royal Society is a long-standing scheme that strives to promote the value and importance of science by connecting academia, industry and government. Stefan has taken up his Industry Fellowship with the Arup Group in September 2023, and will be spending 50% of this time over the next four years in Arup’s team of Numerical Analysts and Algorithm developers. Among other things, Stefan’s project explores the potential of incorporating randomized sketching into the Oasys GSA structural design and analysis software, which is used world-wide by Arup engineers and also sold externally to solve complex design problems. 

The Royal Society Industry Fellowships are very competitive, and Stefan is only the third mathematician ever to receive it. Congratulations Stefan!

Stefan presenting his project at the Royal Society in London (24 November 2023)

NLA Group and Arup win Technical Excellence Award at Innovate UK’s Knowledge Transfer Partnership Awards 2023

The Numerical Linear Group has a long-standing collaboration with Arup, a global firm of designers and experts working in the sustainable development of the built and natural environment. Modelling and simulation are central to Arup’s work and they use state-of-the-art computational methods to enable engineers to solve complex design problems accurately and with confidence in their safety and sustainability.

Professors Françoise Tisseur, Nick Higham, and Stefan Güttel, as well as Arup’s Dr. Chris Hickey and Ramaseshan Kannan completed a 30-month Knowledge Transfer Partnership (KTP). The project led to the incorporation of novel numerical linear algebra algorithms into Arup’s finite element structural analysis package Oasys GSA. An independent grading panel led by InnovateUK scored the project outcomes with the highest possible grade of ‘Excellent’. In November 2023, the project won the Technical Excellence Award at the Innovate UK KTP Awards 2023. At the Awards ceremony, Chris represented Arup as the Numerical Algorithms Developer, in collaboration with the University of Manchester’s Numerical Algorithms Group

Building on earlier work by Mante Zemaityte, Françoise Tisseur, and Ramaseshan Kannan, the team worked together to implement and improve a new sparse eigensolver, MASIL. The new solver can target eigenvalues with the desired properties, without the need to process the entire spectrum. This algorithm is key to how seismic and structural engineers simulate, predict and design buildings and structures to ensure their safety in earthquakes. The new approach allows engineers to specify the mass participation requirement needed from a modal analysis and can cut down analysis times by only finding the modes required for response spectrum analysis. Implementing this work into Oasys GSA has radically reduced the computational cost – as measured by both memory consumption and runtime – to execute seismic simulations, whilst simultaneously making them more accurate than incumbent approaches. 

The team continues collaborating post the KTP. An ongoing collaboration aims to create a new algorithm that extends MASIL’s capabilities to compute modal responses only for certain parts of a structure, a task that would otherwise necessitate the computation of a very large number of eigenpairs.

Starting September 2023, Professor Güttel’s Royal Society Industry Fellowship in collaboration with Arup’s Algorithm and Numerical Analysis team will further boost the group’s interactions with Arup.

The team with Innovate UK Technical Excellence Award. Left to right: Gihan Weeransinghe, Françoise Tisseur, Chris Hickey, Stefan Güttel, Ramaseshan Kannan

ICIAM 2023 Minisymposium on Stochastic Rounding for Reduced-Precision Arithmetic in Scientific Computing

This minisymposium, organized by Massimiliano Fasi and Mantas Mikaitis with Xiaobo Liu as chair, took place during the 10th International Congress on Industrial and Applied Mathematics which was held on 20-25 August, 2023 at Waseda University, Tokyo, Japan. Here we provide slides of the talks that were delivered during this minisymposium.

Abstract: The comeback that stochastic rounding has made in the last few years can be attributed to the availability of hardware implementing low-precision floating-point arithmetic, as well as to the recognition that, in some applications, this rounding mode can control the growth of rounding errors better than commonly used alternatives. Research has focused not only on obtaining efficient hardware and software implementations, but also on understanding the numerical properties of algorithms that replace round-to-nearest with stochastic rounding. In this minisymposium, we will have an opportunity to learn about recent advances in both directions.

Link to the abstracts of the talks: https://iciam2023.org/registered_data?id=00827#03817.

Implementation of Stochastic Rounding. Mantas Mikaitis, University of Leeds.

This talk is based on

Software Simulation of Stochastic Rounding. Massimiliano Fasi, Durham University; Mantas Mikaitis, University of Leeds.

This talk is based on

Bounds on Non-linear Errors for Variance Computation with Stochastic Rounding. El-Mehdi El Arar, Paris-Saclay University-UVSQ- LI-PaRAD; Devan Sohier, Paris-Saclay University-UVSQ- LI-PaRAD; Pablo de Oliveira Castro, Paris-Saclay University-UVSQ- LI-PaRAD; Eric Petit, Intel Corp.

This talk is based on

Trace estimation via asynchronous stochastic rounding. Lior Horesh, IBM T. J. Watson Research Center; Vasileios Kalantzis, IBM T. J. Watson Research Center; Georgios Kollias, IBM T. J. Watson Research Center; Shashanka Ubaru, IBM T. J. Watson Research Center; Chai Wah Wu, IBM T. J. Watson Research Center.

Update (18/10/2023): The authors have provided the following updated slides, which contain corrections to some of the formulas.

NLA Group Talks at ILAS 2023 Conference

Three members of the Numerical Linear Algebra Group attended the 25th Conference of the International Linear Algebra Society in Madrid, Spain, June 12-16, 2023.

Professor Stefan Guttel gave his ILAS Taussky-Todd Prize lecture Randomized Sketching for Krylov Methods.

Professor Nick Higham gave his Hans Schneider Prize lecture Matrix Stories and also spoke on Probabilistic Rounding Error Analysis in Numerical Linear Algebra.

Professor Françoise Tisseur spoke on Eigenvector Error Bounds for Nonlinear Eigenvalue Problems.

Stefan Guettel
Nick Higham

Experiences with the Multiprecision Computing Toolbox

The Advanpix Multiprecision Computing (MP) Toolbox is a MATLAB extension for numerical computing with arbitrary precision [1]. Some members of our Numerical Linear Algebra Group have been long-time users of this toolbox for the research, implementation, and testing of numerical algorithms. A particular feature of the MP Toolbox over MATLAB’s own variable precision arithmetic (VPA) is the comparably low overhead at which multiprecision computations can be performed.

Here is a quick comparison of the MP Toolbox version 4.9.3.15018 versus MATLAB R2022A’s VPA, both run on a standard Windows laptop with a 4-core Intel i7 CPU:

rng(0); A = randn(100);
mp.Digits(50);    % MP Toolbox
A1 = mp(A);
tic; 
[V,D] = eig(A1);  % about 1.6 seconds
toc

digits(50);       % VPA
A2 = vpa(A);
tic; 
[V,D] = eig(A2);  % about 142 seconds
toc

For this eigendecomposition of a 100×100 matrix, the measured speedup is about 89. Some of MP Toolbox’s speed advantage might be attributable to the efficient utilization of multiple cores, but the big difference in timing suggests an overall more efficient implementation compared to VPA. More timing comparisons are listed on the MP Toolbox website [1]. 

Another advantage of the MP Toolbox is its reliability. MATLAB’s VPA can sometimes give plainly wrong results or behave unexpectedly. Here are two examples taken from [2]:

% completely wrong result with MATLAB’s VPA
digits(34);
real(bessely(vpa(0),vpa(1000i)))  % expect -1.2805717...e-436 (i.e. tiny!)
ans = 
-2.540999...e+381

% diff behaves differently on VPA and double matrices
A = [ 1; 2; 3 ]
diff(vpa(A))                 % expect [ 1; 1 ]
ans =      
0
0
0

In both cases, the MP Toolbox gives the expected results.

There are situations where VPA cannot be used simply because not all MATLAB functions are overloaded for VPA matrices. We experienced this issue when developing the Rational Krylov Toolbox [3]. One of the functionalities required when converting between different representations of rational functions is the accurate solution of potentially ill-conditioned generalized eigenvalue problems. It is not currently possible to call eig(vpa(A),vpa(B)), while with the MP Toolbox calling eig(mp(A),mp(B)) gives the intended result.

As far as we are aware, the MP Toolbox is the best way to do multiprecision computations in MATLAB efficiently and reliably. Over the years our group had very professional and swift support from Pavel Holoborodko, the lead developer of the Advanpix MP Toolbox. We would like to thank him for his dedication.


[1] Multiprecision Computing Toolbox for MATLAB (advanpix.com)
[2] User’s Manual (advanpix.com) 
[3] Computing with rational functions (guettel.com)

Chris Hickey Wins Bronze Medal at STEM for Britain

Congratulations to Chris Hickey for wining a bronze medal at the 2023 STEM for Britain in the Mathematical Science category for his poster Seismic Simulations: Implementing and Improving a New Dynamic Structural Analysis.

This work was accomplished when Chris was a Research Associate on a Knowledge Transfer Partnership (KTP) between the University of Manchester and Arup Ltd. Chris implemented and improved MASIL, a method for dynamic structural analysis developed in the NLA group (F. Tisseur and M. Zemaityte) in collaboration with Arup (R. Kannan).

STEM for Britain is an exhibition of posters by early-career research scientists, engineers and mathematicians that takes place every year in the Houses of Parliament during British Science Week.

The full list of this year’s winners is here.

SIAM CSE23 minisymposium on “Mixed precision algorithms in numerical linear algebra”

Erin Carson, Nick Higham, and Theo Mary organized a double minisymposium “Mixed Precision Algorithms in Numerical Linear Algebra” (Part I, Part II) at the SIAM Conference on Computational Science and Engineering (CSE23), which took place in Amsterdam on February 26 – March 3, 2023.

Minisymposium abstract: The increasing support of lower precision arithmetics in hardware provides new opportunities for high performance scientific computing. However, even though low precision arithmetics can provide significant speed, communication, and energy benefits, their use in scientific computing poses the challenge of preserving the accuracy and stability of the computation. To address this issue, a variety of mixed precision algorithms that combine low and high precisions have emerged. This MS will discuss recent advances in mixed precision algorithms for a broad range of numerical linear algebra computations, including matrix multiplication, matrix factorizations, iterative solvers, least-square problems, and matrix and tensor low-rank approximations.

Below we provide the slides of the ten talks that were delivered during this minisymposium.

Nick Higham Elected International Member of US National Academy of Engineering

Congratulations to Professor Nick Higham, who has been elected an International Member of the US National Academy of Engineering. The citation reads “For design and analysis of matrix algorithms widely used in diverse engineering applications”.

For more details see https://www.manchester.ac.uk/discover/news/professor-nick-higham-elected-international-member-of-national-academy-of-engineering/

Nick Higham

Numerical Linear Algebra Group Activities 2022

During 2022 the Numerical Linear Algebra Group introduced a new logo, designed by Massimiliano Fasi, former PhD student and Research Associate in the group.

We published interviews with alumni Younes Chahlaoui and Vanni Noferini.

In addition to our papers in journals we published articles in SIAM News:

and a book

The award of the ACM A. M. Turing Award to Jack Dongarra was a highlight.

PhD Students

Zhengbo Zhou started as a PhD student, working with Nick Higham and Françoise Tisseur.

Xiaobo Liu (Computing Matrix Functions in Arbitrary Precision Arithmetic) and Michael Connolly (Probabilistic Rounding Error Analysis for Numerical Linear Algebra) successfully defended their PhD dissertations. Michael is now working as a data scientist at Bet365.

Postdoctoral Research Associates (PDRAs)

Xiaobo Liu and Bastien Vieuble took up PDRA positions towards the end of the year to work with Nick Higham.

Mantas Mikaitis left the group to take up a lectureship in the School of Computing at the University of Leeds on September 1st. He joined us in 2019 to take up his EPSRC Doctoral Prize Fellowship and he was a PDRA in the group from 2020.

Presentations at Conferences and Workshops

International Congress of Mathematics (ICM), July 6–14, 2022: Higham, invited sectional talk Numerical Stability of Algorithms at Extreme Scale and Low Precisions (slides, video).

A Journey in Numerical Linear Algebra: A Workshop in Honor of Michele Benzi’s 60th Birthday, University of Pisa, June 10–11, 2022: Higham.

Linear Algebra, Matrix Analysis and Applications-ALAMA 2022-ALN2gg, Madrid, 1–3 June 2022: Tisseur.

Householder Symposium XXI on Numerical Linear Algebra, Selva di Fasano, Italy, 12–17 June 2022: Fasi, Tisseur.

Computational Mathematics for Quantum Technologies, Bath, August 1–5, 2022: Güttel.

7th IMA Conference on Numerical Linear Algebra and Optimization, University of Birmingham, June 29–July 1, 2022: Liu, McInnerney.

2022 SIAM Annual Meeting, July 11–15, 2022: Liu.

Conference and Workshop Organization

Sixteen members of the Group attended a two-day creativity Workshop held in April 2022, facilitated by Dennis Sherwood, an expert in creativity. See this report on the workshop.

Mantas Mikaitis and Nick Higham organized a double minisymposium Understanding and Exploiting Mixed-Precision Accelerators for High-Performance Computing at the SIAM Conference on Parallel Processing for Scientific Computing (PP22) in February 2022. Slides of some of the talks are available.

The conference Advances in Numerical Linear Algebra: Celebrating the 60th Birthday of Nick Higham was held at the University of Manchester, July 6–8, 2022, organized by Stefan Güttel, Sven Hammarling, Stephanie Lai, Françoise Tisseur and Marcus Webb. Most of the talks are available on the NLA Group YouTube channel and links to them are available on the conference web page. Photos are available here.

Recognition and Service

Jack Dongarra received the 2021 ACM A.M. Turing Award.

Nick Higham was elected Fellow of Royal Academy of Engineering.

Stefan Güttel was awarded the 2023 ILAS Taussky–Todd Prize.

Stefan Güttel was reappointed for another term as a member of the SIAM Membership Committee, 1/1/2023–12/31/2025.

« Older Entries