"We have never really hung out without a reason except to get loaded," "Jackass" star told The Fix

Film critic admits he has "no way of knowing" whether Dunn was driving while intoxicated at the time of his death