New-pipeline: Performance of fusion analysis

Abierto
#585 0 comentarios 0 reacciones 0 asignados Ver en GitHub

Nadie ha tomado este issue todavía.

Evaluación

Dificultad
5/5
Tiempo estimado
Más de una semana
Aptitud para principiantes
25/100
Tipo de issue
Error
Claridad
Bastante claro
Estado de actividad
Activo
Stack tecnológico
haskell
Área
performance

Línea de trabajo

Start by reading the new-pipeline fusion implementation and how it builds and solves the ILP with CBC; the issue does not name specific files or tests. Use the radixsort nofib test as the performance case, and compare solver options or approaches described here. Done means fusion performance is improved and the radixsort test is enabled again.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

In the new-pipeline, fusion uses an ILP (MIP) to find the best way to fuse the program. The ILP is solved using CBC. However, CBC is very slow on some programs. This includes the radixsort test in our nofib test suite. We should thus optimize fusion.

Possible solutions include:

  • Switch to HiGHS (if HiGHS is faster than CBC on our ILP instances)
  • Implement a custom constraint solver and optimize using domain knowledge (see https://github.com/ivogabe/accelerate/pull/31 for initial work in this direction)
  • Settle with approximations from CBC: give CBC a timeout and let it return the best-known solution it found so far. Downside: solution becomes non-deterministic, and this fails if no solution was found before the timeout.
  • Instruct CBC to use multiple cores. This does not give sufficient speedup, but would be a small quick win. CBC can run with multiple cores, but if I remember correctly, Haskell-MIP cannot parse the result as CBC prints a message that it is using multiple cores (should be easy to fix though).
  • Disable in-place updates. This is not a real solution, since we really want to have in-place updates, but the ILP got a lot more complex due to the addition of in-place updates.

The radixsort test is temporarily disabled until this issue is fixed (See c6e328906f77affe2d6e9d6d1a64ba2542ada7d8). We should enable the test again when this issue is resolved.

Lenguaje dominante
Haskell
Estrellas
1k
Forks
138
Métricas de merge de PR
Sin PR fusionados en 30 d

Preparar el entorno

  • Sin Dockerfile ni archivo de Docker Compose
  • Tiene una plantilla de pull request
  • Sin guía de contribución

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de AccelerateHS/accelerate

Todos los issues de AccelerateHS/accelerate

Issues similares

Más issues de Haskell

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.