Questions or comments regarding 6.566? Contact us on Piazza or send e-mail to the 6.566 staff at 6566-staff@lists.csail.mit.edu.
You will do a sequence of labs in 6.566. These labs will give you practical experience with common attacks and counter-measures. To make the issues concrete, you will explore the attacks and counter-measures in the context of the zoobar web application in the following ways:
Lab 1 will introduce you to buffer overflow vulnerabilities, in the context of a web server called zookws. The zookws web server runs a simple python web application, zoobar, with which users transfer "zoobars" (credits) between each other. You will find buffer overflows in the zookws web server code, write exploits for the buffer overflows to inject code into the server over the network, and figure out how to bypass non-executable stack protection. Later labs look at other security aspects of the zoobar and zookws infrastructure.
Each lab requires you to learn a new programming language or some other piece of infrastructure. For example, in this lab you must become intimately familiar with certain aspects of the C language, x86 assembly language, gdb, etc. Detailed familiarity with many different pieces of infrastructure is needed to understand attacks and defenses in realistic situations: security weaknesses often show up in corner cases, and so you need to understand the details to craft exploits and design defenses for those corner cases. These two factors (new infrastructure and details) can make the labs time consuming. You should start early on the labs and work on them daily for some limited time (each lab has several exercises), instead of trying to do all exercises in a single shot just before the deadline. Take the time to understand the relevant details. If you get stuck, post a question on Piazza.
Several labs, including this lab, ask you to design exploits. These exploits are realistic enough that you might be able to use them for a real attack, but you should not do so. The point of the designing exploits is to teach you how to defend against them, not how to use them---attacking computer systems is illegal (see MIT network rules) and can get you into serious trouble. Don't do it.
NOTE: Since we re-use the same lab assignments across years, we ask that you please do not make your lab code publicly accessible (e.g., by checking your solutions into a public repository on GitHub). This helps keep the labs fair and interesting for students in future years.
Exploiting buffer overflows requires precise control over the execution environment. A small change in the compiler, environment variables, or the way the program is executed can result in slightly different memory layout and code structure, thus requiring a different exploit. For this reason, this lab uses a virtual machine to run the vulnerable web server code.
We have prepared a virtual machine for you containing a standard installation of Ubuntu 22.04 Linux, which you can download here and unpack it on your computer. To start working on this lab assignment, you'll need some way to run this virtual machine. There are a few options:
Linux with an x86 CPU. Use KVM, which is built into the Linux kernel. KVM should be available through your distribution, and is preinstalled on Athena cluster computers; on Debian or Ubuntu, try apt-get install qemu-kvm. KVM requires hardware virtualization support in your CPU, and you must enable this support in your BIOS (which is often, but not always, the default). If you have another virtual machine monitor installed on your machine (e.g., VMware), that virtual machine monitor may grab the hardware virtualization support exclusively and prevent KVM from working.
To start the VM with KVM, unpack the zip file you downloaded above and run ./6.566-standalone-v24.sh from a terminal (Ctrl+A x to force quit). If you get a permission denied error from this script, try adding yourself to the kvm group with sudo gpasswd -a `whoami` kvm, then log out and log back in.
Windows with an x86 CPU (most of them). Download VMware Workstation from IS&T. To start the course VM using VMware, import 6.566-standalone-v24.vmdk. Go to File > New, select "create a custom virtual machine", choose Linux > Debian 9.x 64-bit, choose Legacy BIOS, and use an existing virtual disk (and select the 6.566-standalone-v24.vmdk file, choosing the "Take this disk away" option). Finally, click Finish to complete the setup.
Mac with an x86 CPU (e.g., not M1). Download UTM. For setup, click "Create a New Virtual Machine", click "Emulate", click "Other", check "Skip ISO boot", specify drive size as 24 GB, and continue through to creation. After creation, right click on your VM, click "edit", right click on "IDE Drive", click "delete", click "New" Drive, click "Import", and open the "vmdk" file from the course VM download. To add port forwarding, click "Network", switch "Network Mode" to "Emulated VLAN", switch "Network Card" to "virtio-net-pci", click the "Port Forward" dropdown, click "New", fill "22" into the 2nd box and "2222" into the 4th box.
AWS EC2, for users of non-x86 computers. If you are using a computer with a non-x86 CPU, running the VM locally on your computer may be prohibitively slow, because your VM will have to emulate x86 instructions instead of running them natively. To avoid this, we suggest that you run the course VM on Amazon's AWS EC2 cloud computing platform, as described here. You will not need to download the course VM zip file, as we have already created an AMI for the course VM.
You will use the student account in the VM for your work. The password for the student account is student. You can also get access to the root account in the VM using sudo; for example, you can install new software packages using sudo apt-get install pkgname.
You can either log into the virtual machine using its console, or use ssh to log into the virtual machine over the (virtual) network. The latter also lets you easily copy files into and out of the virtual machine with scp or rsync. How you access the virtual machine over the network depends on how you're running it. If you're using VMWare, you'll first have to find the virtual machine's IP address. To do so, log in on the console, run ip addr show dev eth0, and note the IP address listed beside inet. With kvm, you can use localhost as the IP address for ssh and HTTP. You can now log in with ssh by running the following command from your host machine: ssh -p 2222 student@IPADDRESS.
For security, SSH does not allow logging in over the network using a password (and, in this specific case, the password is known to everyone). To log in via SSH, you will need to set up an SSH Key.
You may also find it helpful to create a host alias for your 6.566 VM in your ~/.ssh/config file, so that you can simply run, for example, ssh 566vm or scp file.txt 566vm:lab/file.txt. To do this, add the following lines to your ~/.ssh/config file, adjusted as needed:
Host 566vm User student HostName localhost Port 2222
The course Git repository is available at https://github.com/mit-pdos/6.566-lab-2024. To get the lab code, log into the VM using the student account and clone the source code for lab 1 as follows:
student@6566-v24:~$ git clone https://github.com/mit-pdos/6.566-lab-2024 lab Cloning into 'lab'... student@6566-v24:~$ cd lab student@6566-v24:~/lab$
It's important that you clone the course repository into the lab directory, because the length of pathnames will matter in this lab.
Before you proceed with this lab assignment, make sure you can compile the zookws web server:
student@6566-v24:~/lab$ make
cc zookd.c -c -o zookd.o -m64 -g -std=c99 -Wall -Wno-format-overflow -D_GNU_SOURCE -static -fno-stack-protector
cc http.c -c -o http.o -m64 -g -std=c99 -Wall -Wno-format-overflow -D_GNU_SOURCE -static -fno-stack-protector
cc -m64 zookd.o http.o -o zookd
cc -m64 zookd.o http.o -o zookd-exstack -z execstack
cc -m64 zookd.o http.o -o zookd-nxstack
cc zookd.c -c -o zookd-withssp.o -m64 -g -std=c99 -Wall -Wno-format-overflow -D_GNU_SOURCE -static
cc http.c -c -o http-withssp.o -m64 -g -std=c99 -Wall -Wno-format-overflow -D_GNU_SOURCE -static
cc -m64 zookd-withssp.o http-withssp.o -o zookd-withssp
cc -m64 -c -o shellcode.o shellcode.S
objcopy -S -O binary -j .text shellcode.o shellcode.bin
cc run-shellcode.c -c -o run-shellcode.o -m64 -g -std=c99 -Wall -Wno-format-overflow -D_GNU_SOURCE -static -fno-stack-protector
cc -m64 run-shellcode.o -o run-shellcode
student@6566-v24:~/lab$
The component of zookws that receives HTTP requests is zookd. It is written in C and serves static files and executes dynamic scripts. For this lab you don't have to understand the dynamic scripts; they are written in Python and the exploits in this lab apply only to C code. The HTTP-related code is in http.c. Here is a tutorial about the HTTP protocol.
There are two versions of zookd you will be using:
In order to run the web server in a predictable fashion---so that its stack and memory layout is the same every time---you will use the clean-env.sh script. This is the same way in which we will run the web server during grading, so make sure all of your exploits work on this configuration!
The reference binaries of zookd are provided in bin.tar.gz, which we will use for grading. Make sure your exploits work on those binaries. The make check-lab1 command will always use both clean-env.sh and bin.tar.gz to check your submission.
Now, make sure you can run the zookws web server and access the zoobar web application from a browser running on your machine, as follows:
student@6566-v24:~/lab$ ./clean-env.sh ./zookd 8080
The ./clean-env.sh commands starts zookd on port 8080. To open the zoobar application, open your browser and point it at the URL http://IPADDRESS:8080/, where IPADDRESS is the VM's IP address we found above. If something doesn't seem to be working, try to figure out what went wrong, or contact the course staff, before proceeding further.
In the first part of this lab assignment, you will find buffer overflows in the provided web server. To do this lab, you will need to understand the basics of buffer overflows. To help you get started with this, you should read Smashing the Stack in the 21st Century, which goes through the details of how buffer overflows work, and how they can be exploited.
Exercise 1. Study the web server's C code (in zookd.c and http.c), and find one example of code that allows an attacker to overwrite the return address of a function. Hint: look for buffers allocated on the stack.
For your vulnerability, try to identify the buffer which may overflow, how you would structure the input to the web server (i.e., the HTTP request) to overflow the buffer and overwrite the return address, and the call stack that will trigger the buffer overflow (i.e., the chain of function calls starting from process_client).
It is worth taking your time on this exercise and familiarizing yourself with the code, because your next job is to exploit the vulnerability you identified. In fact, you may want to go back and forth between this exercise and later exercises, as you work out the details and document them. That is, if you find a buffer overflow that you think can be exploited, you can use later exercises to figure out if it indeed can be exploited. It will be helpful to draw a stack diagram (on paper) like the figures in Smashing the Stack in the 21st Century.
Now, you will start developing exploits to take advantage of the buffer overflows you have found above. We have provided template Python code for an exploit in /home/student/lab/exploit-template.py, which issues an HTTP request. The exploit template takes two arguments, the server name and port number, so you might run it as follows to issue a request to zookws running on localhost:
student@6566-v24:~/lab$ ./clean-env.sh ./zookd-exstack 8080 & [1] 2676 student@6566-v24:~/lab$ ./exploit-template.py localhost 8080 HTTP request: b'GET / HTTP/1.0\r\n\r\n' ... student@6566-v24:~/lab$
You are free to use this template, or write your own exploit code from scratch. Note, however, that if you choose to write your own exploit, the exploit must run correctly inside the provided virtual machine.
You may find gdb useful in building your exploits (though it is not required for you to do so). As zookd forks off many processes (one for each client), it can be difficult to debug the correct one. The easiest way to do this is to run the web server ahead of time with clean-env.sh and then attaching gdb to an already-running process with the -p flag. You can find the PID of a process by using pgrep; for example, to attach to zookd-exstack, start the server and, in another shell, run
student@6566-v24:~/lab$ gdb -p $(pgrep zookd-) ... (gdb) break your-breakpoint Breakpoint 1 at 0x1234567: file zookd.c, line 999. (gdb) continue Continuing.
Keep in mind that a process being debugged by gdb will not get killed even if you terminate the parent zookd process using ^C. If you are having trouble restarting the web server, check for leftover processes from the previous run, or be sure to exit gdb before restarting zookd. You can also save yourself some typing by using b instead of break, and c instead of continue.
When a process being debugged by gdb forks, by default gdb continues to debug the parent process and does not attach to the child. Since zookd forks a child process to service each request, you may find it helpful to have gdb attach to the child on fork, using the command set follow-fork-mode child. By default, gdb will detach from the parent, but it can be convenient to have it remain attached, so you can repeatedly try exploits without quitting and re-starting (and setting up again) the debugger. This is done using the command set detach-on-fork off. See the reference on inferiors (the name GDB uses for processes) for how to switch between parent and child. When the child exists, you can use inferior 1 to switch back to the parent. We have added the two settings to /home/student/.gdbinit.
As you develop your exploit, you may discover that it causes the server to hang as opposed to crash, depending on what buffer overflow you are trying to take advantage of and what data you are overwriting in the running server. You can dig into the details of why the hang happens, to understand how you are affecting the server's execution, in order to make your exploit avoid the hang and instead crash the server. Or you can choose to exploit a different buffer overflow that avoids the hanging behavior.
For this and subsequent exercises, you may need to encode your attack
payload in different ways, depending on which vulnerability you are
exploiting. In some cases, you may need to make sure that your attack
payload is URL-encoded; that is, use + instead of
space and %2b instead of +. Here is a URL
encoding reference and a handy conversion
tool. You can also use quoting functions in the python urllib
module to URL-encode bytes (in particular,
urllib.parse.quote_from_bytes,
followed by .encode('ascii') to get the bytes from the string).
In other cases, you may need to include
binary values into your payload. The Python
struct module
can help you do that. For example, struct.pack("<Q", x) will
produce an 8-byte (64-bit) binary encoding of the integer x.
Exercise 2. Write an exploit that uses a buffer overflow to crash the web server (or one of the processes it creates). You do not need to inject code at this point. Verify that your exploit crashes the server by checking the last few lines of sudo dmesg | tail, using gdb, or observing that the web server crashes (i.e., it will print Child process 9999 terminated incorrectly, receiving signal 11)
Provide the code for the exploit in a file called exploit-2.py.
The vulnerability you found in Exercise 1 may be too hard to exploit. Feel free to find and exploit a different vulnerability.
You can check whether your exploits crash the server as follows:
student@6566-v24:~/lab$ make check-crash
In this part, you will use your buffer overflow exploits to inject code into the web server. The goal of the injected code will be to unlink (remove) a sensitive file on the server, namely /home/student/grades.txt. Use zookd-exstack, since it has an executable stack that makes it easier to inject code. The zookws web server should be started as follows.
student@6566-v24:~/lab$ ./clean-env.sh ./zookd-exstack 8080
You can build the exploit in two steps. First, write the shell code that unlinks the sensitive file, namely /home/student/grades.txt. Second, embed the compiled shell code in an HTTP request that triggers the buffer overflow in the web server.
When writing shell code, it is often easier to use assembly language rather than higher-level languages, such as C. This is because the exploit usually needs fine control over the stack layout, register values and code size. The C compiler will generate additional function preludes and perform various optimizations, which makes the compiled binary code unpredictable.
We have provided shell code for you to use in /home/student/lab/shellcode.S, along with Makefile rules that produce /home/student/lab/shellcode.bin, a compiled version of the shell code, when you run make. The provided shell code is intended to exploit setuid-root binaries, and thus it runs a shell. You will need to modify this shell code to instead unlink /home/student/grades.txt.
To help you develop your shell code for this exercise, we have provided a program called run-shellcode that will run your binary shell code, as if you correctly jumped to its starting point. For example, running it on the provided shell code will cause the program to execve("/bin/sh"), thereby giving you another shell prompt:
student@6566-v24:~/lab$ ./run-shellcode shellcode.bin
Exercise 3 (warm-up). Modify shellcode.S to unlink /home/student/grades.txt. Your assembly code can either invoke the SYS_unlink system call, or call the unlink() library function.
To test whether the shell code does its job, run the following commands:
student@6566-v24:~/lab$ make student@6566-v24:~/lab$ touch ~/grades.txt student@6566-v24:~/lab$ ./run-shellcode shellcode.bin # Make sure /home/student/grades.txt is gone student@6566-v24:~/lab$ ls ~/grades.txt ls: cannot access /home/student/grades.txt: No such file or directory
You may find strace useful when trying to figure out what system calls your shellcode is making. Much like with gdb, you attach strace to a running program:
student@6566-v24:~/lab$ strace -f -p $(pgrep zookd-)
It will then print all of the system calls that program makes. If your shell code isn't working, try looking for the system call you think your shell code should be executing (i.e., unlink), and see whether it has the right arguments.
Next, we construct a malicious HTTP request that injects the compiled byte code to the web server, and hijack the server's control flow to run the injected code. When developing an exploit, you will have to think about what values are on the stack, so that you can modify them accordingly.
When you're constructing an exploit, you will often need to know the addresses of specific stack locations, or specific functions, in a particular program, without changing the program itself (which could change those addresses). We recommend using gdb. For example, suppose you want to know the stack address of the pn[] array in the http_serve function in zookd-exstack, and the address of its saved return pointer. You can obtain them using gdb by first starting the web server (remember clean-env!), and then attaching gdb to it:
student@6566-v24:~/lab$ gdb -p $(pgrep zookd-) ... (gdb) break http_serve Breakpoint 1 at 0x5555555561c4: file http.c, line 275. (gdb) continue Continuing.
Now you can issue an HTTP request to the web server, so that it triggers the breakpoint, and so that you can examine the stack of http_serve.
student@6566-v24:~/lab$ curl localhost:8080
This will cause gdb to hit the breakpoint you set and halt execution,
and give you an opportunity to ask gdb for addresses you are
interested in:
Thread 2.1 "zookd-exstack" hit Breakpoint 1, http_serve (fd=4, name=0x55555575fcec "/") at http.c:275 275 void (*handler)(int, const char *) = http_serve_none; (gdb) print &pn $1 = (char (*)[2048]) 0x7fffffffd4a0 (gdb) info frame Stack level 0, frame at 0x7fffffffdcd0: rip = 0x5555555561c4 in http_serve (http.c:275); saved rip = 0x55555555587b called by frame at 0x7fffffffed00 source language c. Arglist at 0x7fffffffdcc0, args: fd=4, name=0x55555575fcec "/" Locals at 0x7fffffffdcc0, Previous frame's sp is 0x7fffffffdcd0 Saved registers: rbx at 0x7fffffffdcb8, rbp at 0x7fffffffdcc0, rip at 0x7fffffffdcc8 (gdb)
From this, you can tell that, at least for this invocation of http_serve, the pn[] buffer on the stack lives at address 0x7fffffffd4a0, and the saved value of %rip (the return address in other words) is at 0x7fffffffdcc8. If you want to see register contents, you can also use info registers.
Now it's your turn to develop an exploit.
Exercise 4. Starting from one of your exploits from Exercise 2, construct an exploit that hijacks the control flow of the web server and unlinks /home/student/grades.txt. Save this exploit in a file called exploit-4.py.
Verify that your exploit works; you will need to re-create /home/student/grades.txt after each successful exploit run.
To do this exercise, first focus on obtaining control of the program counter. Draw (on paper) the stack layout that you expect the program to have at the point when you overflow the buffer, and use gdb to verify that your overflow data ends up where you expect it to. Step through the execution of the function to the return instruction to make sure you can control what address the program returns to. The next, stepi, and x commands in gdb should prove helpful.
Once you can reliably hijack the control flow of the program, find a suitable address that will contain the code you want to execute, and focus on placing the correct code at that address---e.g. a derivative of the provided shell code.
You can check whether your exploit works as follows:
student@6566-v24:~/lab$ make check-exstack
The test either prints "PASS" or "FAIL". We will grade your exploits in this way. Do not change the Makefile.
The standard C compiler used on Linux, gcc, implements a version of stack canaries (called SSP). You can explore whether GCC's version of stack canaries would or would not prevent a given vulnerability by using the SSP-enabled versions of zookd: zookd-withssp.
Submit your answers to the first two parts of this lab assignment by running make handin.zip and upload the resulting handin.zip file to the Gradescope submission web site.
Many modern operating systems mark the stack non-executable in an attempt to make it more difficult to exploit buffer overflows. In this part, you will explore how this protection mechanism can be circumvented. Run the web server configured with binaries that have a non-executable stack, as follows.
student@6566-v24:~/lab$ ./clean-env.sh ./zookd-nxstack 8080
The key observation to exploiting buffer overflows with a non-executable stack is that you still control the program counter, after a ret instruction jumps to an address that you placed on the stack. Even though you cannot jump to the address of the overflowed buffer (it will not be executable), there's usually enough code in the vulnerable server's address space to perform the operation you want.
Thus, to bypass a non-executable stack, you need to first find the code you want to execute. This is often a function in the standard library, called libc, such as execve, system, or unlink. Then, you need to arrange for the stack and registers to be in a state consistent with calling that function with the desired arguments. Finally, you need to arrange for the ret instruction to jump to the function you found in the first step. This attack is often called a return-to-libc attack.
One challenge with return-to-libc attacks is that you need to pass arguments to the libc function that you want to invoke. The x86-64 calling conventions make this a challenge because the first 6 arguments are passed in registers. For example, the first argument must be in register %rdi (see man 2 syscall, which documents the calling convention). So, you need an instruction that loads the first argument into %rdi. In Exercise 3, you could have put that instruction in the buffer that your exploit overflows. But, in this part of the lab, the stack is marked non-executable, so executing the instruction would crash the server, but wouldn't execute the instruction.
The solution to this problem is to find a piece of code in the server that loads an address into %rdi. Such a piece of code is referred to as a "borrowed code chunk", or more generally as a rop gadget, because it is a tool for return-oriented programming (rop). Luckily, zookd.c accidentally has a useful gadget: see the function accidentally.
Exercise 5. Starting from your exploit in Exercises 2 and 4, construct an exploit that unlinks /home/student/grades.txt when run on the binaries that have a non-executable stack. Name this new exploit exploit-5.py.
In this attack you are going to take control of the server over the network without injecting any code into the server. You should use a return-to-libc attack where you redirect control flow to code that already existed before your attack. The outline of the attack is to perform a buffer overflow that:
To do this exercise, it is essential for you to draw a stack diagram like the figures in Smashing the Stack in the 21st Century at (1) the point that the buffer overflows and (2) at the point that accidentally runs.
You can test your exploits as follows:
student@6566-v24:~/lab$ make check-libc
Challenge! (optional) The accidentally function is a bit artificial. For extra credit, figure out how to perform the return-to-libc attack without relying on that function (delete it and find another way to make your exploit work). Provide your attack in exploit-challenge.py. Briefly explain the attack and provide ROP gadgets you use in a comment in exploit-challenge.py.
You will need to find another chunk of code to reuse that gives you control over %rdi. You can read through the disassembly (e.g. using objdump) to look for useful ROP gadgets.
Because of the nature of x86/x86-64, you can use another technique to find sequences of instructions that don't even appear in the disassembly! Instructions are variable-length (from 1 to 15 bytes), and by causing a misaligned parse (by jumping into the middle of an intended instruction), you can cause a sequence of machine code to be misinterpreted. For example, the instruction sequence pop %r15; ret corresponds to the machine code 41 5F C3. But instead of executing from the start of this instruction stream, if you jump 1 byte in, the machine code 5F C3 corresponds to the assembly pop %rdi; ret.
Automated tools such as ROPgadget.py can assist you in searching for ROP gadgets, even finding gadgets that arise from misaligned parses. The 6.566 VM already has ROPgadget installed.
You may find it useful to search for ROP gadgets not just in the zookd binary but in other libraries that zookd loads at runtime. To see these libraries, and the addresses at which they are loaded, you can run ./clean-ldd.sh ./zookd-nxstack 8080. The clean-ldd.sh command is just like clean-env.sh, in that it sets up the same predictable environment used by clean-env.sh, but then prints out the addresses of the mapped shared libraries instead of executing the program.
Finally, you will fix the vulnerabilities that you have exploited in this lab assignment.
Exercise 6. For each buffer overflow vulnerability you have exploited in Exercises 2, 4, and 5, fix the web server's code to prevent the vulnerability in the first place. Do not rely on compile-time or runtime mechanisms such as stack canaries, removing -fno-stack-protector, baggy bounds checking, etc.
Make sure that your code actually stops your exploits from working. Use make check-fixed to run your exploits against your modified source code (as opposed to the staff reference binaries from bin.tar.gz). These checks should report FAIL (i.e., exploit no longer works). If they report PASS, this means the exploit still works, and you did not correctly fix the vulnerability.
Note that your submission should not make changes to the Makefile and other grading scripts. We will use our unmodified version during grading.
You should also make sure your code still passes all tests using make check-lab1, which uses the unmodified lab binaries.
You are done! Submit your answers to the lab assignment by running make handin.zip and upload the resulting handin.zip file to the Gradescope submission web site.
Questions or comments regarding 6.566? Contact us on Piazza or send e-mail to the 6.566 staff at 6566-staff@lists.csail.mit.edu.