Use cgsem timed waits in avalon driver to not miss any queued wake ups to account for async messages coming during a flush work.