Jump Lists were introduced in Windows 7. They help you access recent items from websites to documents more quickly. They’re also available in Windows 8 and here’s how to increase or decrease the number of items in them.
In Windows 8, the Jump Lists are set to 10 items by default. Here’s an example of recent IE websites.
Right click an empty area on the Taskbar and select Properties.
Click the Jump lists tab and set the number of recent items. You can set it from 0-60.
No restart is required, after clicking OK, you’ll see the difference right away.
If you’re running Windows 7 check out how to delete Jump List history.