With your L67 V6 Boost Pulley Upgrade Kit, do ya need to check the allen heads constantly to make sure they stay tight?

If tightened properly, it won't be an issue. In saying this though, it wouldn't be a bad idea to re-tighten the screws after a few days of initially installing the kit.