Se algo (um veneno, uma maldição, uma doença, etc) causar dano ao seu personagem, o dano é feito somente para a habilidade relativa. Então, no seu caso, 2 pontos de dano.
Da seção do SRD do Pathfinder em Dano do Índice de Habilidade :
Diseases, poisons, spells, and other abilities can all deal damage directly to your ability scores. This damage does not actually reduce an ability, but it does apply a penalty to the skills and statistics that are based on that ability.
For every 2 points of damage you take to a single ability, apply a –1 penalty to skills and statistics listed with the relevant ability. If the amount of ability damage you have taken equals or exceeds your ability score, you immediately fall unconscious until the damage is less than your ability score. The only exception to this is your Constitution score. If the damage to your Constitution is equal to or greater than your Constitution score, you die. Unless otherwise noted, damage to your ability scores is healed at the rate of 1 per day to each ability score that has been damaged. Ability damage can be healed through the use of spells, such as lesser restoration.