Memory-mapped files on am EBS volume
First time posting here -- apologies if this question is not appropriate for this forum.
My code is using a library that reads from and writes to a mmap'd file. Right now the file resides on an SSD, and there has been a conversation about hosting it on an EBS volume instead. What would be the risks of doing that? Specifically:
- What would happen when the library attempts to read a page that's not in physical memory while the EBS volume is temporarily unavailable due to network issues?
- What would happen when the OS attempts to flush a dirty page to the EBS volume while it's temporarily unavailable due to network issues?
Thanks in advance!
Answers
-
Please find the risk factors when you move the files from SSD to the EBS volume. Let’s unpack the 3 cases:
- Reading a page from EBS when it’s unavailable
When your program uses a memory-mapped file and tries to read data that isn’t already in memory, the operating system (OS) loads that data from storage.
If the storage is on EBS (Amazon’s network-based disk), this means the OS must fetch the data over the network.
If there’s a temporary network or EBS issue:
The read will pause and your program will hang until the OS gets a response.
If the problem is short-lived, it may recover and continue normally.
If the problem is serious (EBS disconnects, network breaks, etc.), the OS will return an error.
When that happens, your program may get a “bus error” (SIGBUS), which often causes a crash unless it’s handled in code.
In short: reading from an EBS-backed mmap file can freeze or crash your program if the EBS volume goes offline.
- Flushing dirty pages to an unavailable EBS volume
When the OS needs to save modified data (dirty pages) from memory back to the EBS disk:
It starts a write operation to EBS.
If EBS is slow or has temporary issues, the write will stall while the OS keeps retrying.
If the problem lasts, the OS will return I/O errors.
Depending on the filesystem:
The filesystem may switch to read-only mode to protect data.
Your program may see errors when calling msync() or fsync().
Later writes to the mapped file could again trigger a SIGBUS error.
In short: failed writes can freeze your app, cause crashes, or make the filesystem unstable — though journaling filesystems (like ext4) usually prevent total corruption.
- Practical implications
Using memory-mapped files on EBS comes with these risks:
Reads or writes can freeze due to network delays or retries.
Your program can crash (SIGBUS) if EBS disconnects.
The filesystem can become read-only or throw errors if EBS stays unavailable.
By comparison, a local SSD is faster and only fails if the hardware breaks — which is rarer and simpler to handle.
Regards,
Nick R
Cloud Team Lead
AccuWeb.Cloud0
Categories
- All Categories
- 158 LFX Mentorship
- 158 LFX Mentorship: Linux Kernel
- 849 Linux Foundation IT Professional Programs
- 389 Cloud Engineer IT Professional Program
- 186 Advanced Cloud Engineer IT Professional Program
- 88 DevOps Engineer IT Professional Program
- 155 Cloud Native Developer IT Professional Program
- 152 Express Training Courses & Microlearning
- 149 Express Courses - Discussion Forum
- 3 Microlearning - Discussion Forum
- 7.1K Training Courses
- 50 LFC110 Class Forum - Discontinued
- 74 LFC131 Class Forum
- 56 LFD102 Class Forum
- 256 LFD103 Class Forum
- 26 LFD110 Class Forum
- 50 LFD121 Class Forum
- 3 LFD123 Class Forum
- 1 LFD125 Class Forum
- 19 LFD133 Class Forum
- 10 LFD134 Class Forum
- 19 LFD137 Class Forum
- 1 LFD140 Class Forum
- 73 LFD201 Class Forum
- 8 LFD210 Class Forum
- 6 LFD210-CN Class Forum
- 2 LFD213 Class Forum - Discontinued
- LFD221 Class Forum
- 128 LFD232 Class Forum - Discontinued
- 3 LFD233 Class Forum
- 5 LFD237 Class Forum
- 25 LFD254 Class Forum
- 747 LFD259 Class Forum
- 111 LFD272 Class Forum - Discontinued
- 4 LFD272-JP クラス フォーラム - Discontinued
- 16 LFD273 Class Forum
- 451 LFS101 Class Forum
- 3 LFS111 Class Forum
- 4 LFS112 Class Forum
- 5 LFS116 Class Forum
- 9 LFS118 Class Forum
- 2 LFS120 Class Forum
- 12 LFS142 Class Forum
- 9 LFS144 Class Forum
- 6 LFS145 Class Forum
- 6 LFS146 Class Forum
- 7 LFS147 Class Forum
- 21 LFS148 Class Forum
- 17 LFS151 Class Forum
- 6 LFS157 Class Forum
- 91 LFS158 Class Forum
- 1 LFS158-JP クラス フォーラム
- 14 LFS162 Class Forum
- 2 LFS166 Class Forum - Discontinued
- 9 LFS167 Class Forum
- 4 LFS170 Class Forum
- 2 LFS171 Class Forum - Discontinued
- 4 LFS178 Class Forum - Discontinued
- 4 LFS180 Class Forum
- 3 LFS182 Class Forum
- 7 LFS183 Class Forum
- 2 LFS184 Class Forum
- 41 LFS200 Class Forum
- 737 LFS201 Class Forum - Discontinued
- 3 LFS201-JP クラス フォーラム - Discontinued
- 23 LFS203 Class Forum
- 141 LFS207 Class Forum
- 3 LFS207-DE-Klassenforum
- 3 LFS207-JP クラス フォーラム
- 302 LFS211 Class Forum - Discontinued
- 56 LFS216 Class Forum - Discontinued
- 60 LFS241 Class Forum
- 51 LFS242 Class Forum
- 39 LFS243 Class Forum
- 17 LFS244 Class Forum
- 8 LFS245 Class Forum
- 1 LFS246 Class Forum
- 1 LFS248 Class Forum
- 123 LFS250 Class Forum
- 3 LFS250-JP クラス フォーラム
- 2 LFS251 Class Forum
- 163 LFS253 Class Forum
- 1 LFS254 Class Forum - Discontinued
- 3 LFS255 Class Forum
- 15 LFS256 Class Forum
- 2 LFS257 Class Forum
- 1.4K LFS258 Class Forum
- 12 LFS258-JP クラス フォーラム
- 142 LFS260 Class Forum
- 165 LFS261 Class Forum
- 45 LFS262 Class Forum
- 82 LFS263 Class Forum - Discontinued
- 15 LFS264 Class Forum - Discontinued
- 11 LFS266 Class Forum - Discontinued
- 25 LFS267 Class Forum
- 27 LFS268 Class Forum
- 38 LFS269 Class Forum
- 11 LFS270 Class Forum
- 202 LFS272 Class Forum - Discontinued
- 2 LFS272-JP クラス フォーラム - Discontinued
- 2 LFS274 Class Forum - Discontinued
- 4 LFS281 Class Forum - Discontinued
- 30 LFW111 Class Forum
- 265 LFW211 Class Forum
- 190 LFW212 Class Forum
- 17 SKF100 Class Forum
- 2 SKF200 Class Forum
- 3 SKF201 Class Forum
- 800 Hardware
- 200 Drivers
- 68 I/O Devices
- 37 Monitors
- 104 Multimedia
- 175 Networking
- 92 Printers & Scanners
- 85 Storage
- 765 Linux Distributions
- 82 Debian
- 67 Fedora
- 20 Linux Mint
- 13 Mageia
- 23 openSUSE
- 149 Red Hat Enterprise
- 31 Slackware
- 13 SUSE Enterprise
- 356 Ubuntu
- 472 Linux System Administration
- 39 Cloud Computing
- 71 Command Line/Scripting
- Github systems admin projects
- 96 Linux Security
- 78 Network Management
- 102 System Management
- 48 Web Management
- 74 Mobile Computing
- 19 Android
- 42 Development
- 1.2K New to Linux
- 1K Getting Started with Linux
- 387 Off Topic
- 120 Introductions
- 178 Small Talk
- 28 Study Material
- 865 Programming and Development
- 312 Kernel Development
- 535 Software Development
- 1.8K Software
- 269 Applications
- 183 Command Line
- 5 Compiling/Installing
- 988 Games
- 318 Installation
- 109 All In Program
- 109 All In Forum
Upcoming Training
-
August 20, 2018
Kubernetes Administration (LFS458)
-
August 20, 2018
Linux System Administration (LFS301)
-
August 27, 2018
Open Source Virtualization (LFS462)
-
August 27, 2018
Linux Kernel Debugging and Security (LFD440)