Linux Performance Tuning and Stabilization Tips
Presentation
Subtitles
| ⇤ | ⇥ | # | slide |
|---|---|---|---|
| 00:04 | 00:05 | 1 | Linux Performance Tuning and Stabilization Tips |
| 00:18 | 00:19 | 2 | Table of contents |
| 00:47 | 00:48 | 3 | Random Access Memory |
| 02:09 | 02:10 | 4 | Cache hot application data in memory |
| 03:37 | 03:38 | 5 | Buffered I/O |
| 04:55 | 04:56 | 6 | Do not allocate too much memory |
| 06:41 | 06:42 | 7 | What if setting swap size to zero? |
| 08:20 | 08:21 | 8 | Do not set swap=zero |
| 09:51 | 09:52 | 9 | What if stopping OOM Killer? |
| 10:54 | 10:55 | 10 | Swap space management |
| 11:44 | 11:45 | 11 | Be careful about backup operations |
| 12:24 | 12:25 | 12 | vm.swappiness = 0 |
| 13:47 | 13:48 | 13 | Memory allocator |
| 14:47 | 14:48 | 14 | Memory allocator would matter for CPU bound workloads |
| 15:24 | 15:25 | 15 | Be careful about per-session memory |
| 16:59 | 17:00 | 16 | Table of contents |
| 17:06 | 17:07 | 17 | File I/O and synchronous writes |
| 18:56 | 18:57 | 18 | Overwriting or Appending? |
| 20:59 | 21:00 | 19 | Quick file i/o health check |
| 22:07 | 22:08 | 20 | Buffered and asynchronous writes |
| 24:50 | 24:51 | 21 | Filesystem - ext3 |
| 26:15 | 26:16 | 22 | Filesystem - xfs/ext2 |
| 27:48 | 27:49 | 23 | Concurrent write matters on fast storage |
| 28:59 | 29:00 | 24 | I/O scheduler |
| 30:40 | 30:41 | 25 | cfq madness |
| 32:46 | 32:47 | 26 | Changing I/O scheduler (InnoDB) |
| 33:19 | 33:20 | 27 | Changing I/O scheduler queue size (MyISAM) |
| 35:04 | 35:05 | 28 | Useful commands and tools |
| 35:13 | 35:14 | 29 | iostat |
| 36:11 | 36:12 | 30 | iostat example (DBT-2) |
| 37:19 | 37:20 | 31 | mpstat |
| 38:08 | 38:09 | 32 | vmstat and mpstat |
| 38:34 | 38:35 | 33 | Oprofile |
| 39:23 | 39:24 | 34 | Oprofile example |
| 40:17 | 40:18 | 35 | SystemTap |
| 41:26 | 41:27 | 36 | SystemTap use-case 1 : Per-file i/o statistics |
| 42:33 | 42:34 | 37 | Sample Code |
| 43:39 | 43:40 | 38 | SystemTap use-case 2 : Userspace profiling |
| 44:04 | 44:05 | 39 | Background: MySQL Sorting Algorithm |
| 44:14 | 44:15 | 40 | SystemTap Script 2 |
| 44:42 | 44:43 | 41 | gdb |
| 45:30 | 45:31 | 42 | gdb case study |
| 46:10 | 46:11 | 43 | Taking thread dumps with gdb |
| 46:30 | 46:31 | 44 | Stack trace |
| 46:40 | 46:41 | 45 | Reading sql_parse.cc:969 |
| 46:47 | 46:48 | 46 | Who locked LOCK_thread_count for seconds? |
| 46:53 | 46:54 | 47 | Reading mysqld.cc:4811 |
| 47:13 | 47:14 | 48 | Configuration Summary |
| 48:24 | 48:25 | 49 | Enjoy the conference! |
Info
Yoshinori Matsunobu
Linux Performance Tuning and Stabilization Tips
MySQL Conference & Expo,
Santa Clara, CA,
5:15pm Tuesday, 04/13/2010
Many people know Linux terminologies such as ext3, tmpfs, cfq io scheduler, OOM killer, etc. But many times it is not appropriately configured. In this session, the speaker will show Linux performance tuning and stabilization practices for MySQL. The following topics will be covered.
- Filesystem (ext3, xfs, tmpfs, etc)
- Swap and memory management, how to prevent OOM killer
- I/O scheduler settings
- Demistifying iostat and vmstat
- Practical Linux kernel configurations
- Profiling MySQL/Linux activities with SystemTap
- RAID (1+0 vs 5), Logival Volume Manager (LVM) and Partition Management (/, /data, /tmp, etc)
- Is setting swap size to zero fine? Why is it dangerous? How much swap space should I allocate?
- sync-binlog=1 is really slow. Can it be faster by using a filesystem other than ext3?
- I allocate only one Linux partition at / . Is it fine?
- What is the most appropriate I/O scheduler for MySQL? Does it depend on Linux and MySQL version? Is cfq fine for both single-threaded and multi-threaded applications)?
- What is vm.swappiness? What is vm.overcommit_memory?
- What do r/s, wMB/s, %svctm and %util from iostat really mean?
- Is it possible to count up how many times rr_unpack_from_buffer() (MySQL internal function) was called?