phpmyadmin/phpmyadmin

Too much time for a database import

Open

#14,397 opened on Jun 13, 2018

View on GitHub
 (3 comments) (0 reactions) (0 assignees)PHP (6,886 stars) (3,454 forks)batch import
help wanted

Description

Hello,

we know that having a remote host, a local import with mysql is faster than phpmyadmin because there is no time to upload the database, but I noticed something strange and I made the following tests:

  1. Import a 90MB database locally (after send it via scp) via mysql: mysql -u root -pPASS DB_NAME < /tmp/DUMP.sql it takes 1m46s

  2. Import a 90MB database remotely via mysql: mysql -u root -pPASS -h REMOTE_HOST DB_NAME < /tmp/DUMP.sql it takes 1m50s

  3. Import a 90MB database remotely via phpmyadmin: it takes 12m

I guess there is something bad but I don't know where.

I'm using Gentoo as OS, I have nginx+php fpm, following some useful data from php.ini: max_execution_time = 8000 upload_max_filesize = 2048M memory_limit = 1024M post_max_size = 4096M

From php-fpm.conf I have: php_admin_value[memory_limit] = 1024M

Server configuration

Operating system: Gentoo Linux

Web server: Nginx

Database: Mariadb-10.1.29

PHP version: 5.6.33

phpMyAdmin version: 4.8.1

Client configuration

Browser: Chromium-67.0.3396.62

Operating system: Gentoo Linux

Contributor guide

Tech stack
phpmysql
Domain
backenddatabaseperformance
Issue type
performance
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
4
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
3-5 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
needs investigation
Prerequisites
PHPMySQLphpMyAdmin import code
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
30
Research direction
Investigate the import process in phpMyAdmin's code (likely in libraries/classes/Import/). Compare the execution time discrepancy with command line mysql. Possible causes include PHP overhead, multiple queries vs single transaction, or inefficient handling of large SQL files. Look at the Import class and related files to identify bottlenecks. Also consider checking if the issue is related to the use of LOAD DATA LOCAL INFILE or batch inserts.
Too much time for a database import · phpmyadmin/phpmyadmin#14397 | Good First Issue