I really just don’t like using the trackpad… How about if you press the «Add this rem to your edit later document» button, you get a popup with a numbered list of your edit later messages and when you press a number, the message gets assigned and you can continue with the queue. So basically press the «add to edit later» button and then a number.
The popup could look like this with the assigned number to the right (or left but usually shortcuts are to the right)
Also, this is related to Keyboard Driven Workflow and Commands