The Profile picture that is selected for the game is the same profile picture you've used in the Steam App.
You can go into your profile in Steam and adjust your profile picture there. Once completed, start the game (if already on, then restart the game) and your new profile picture should automatically load in.
** If it is not visible yet, give it some time to update. This can several minutes to possibly hours for it to completely update.