Problems with Raycast/AddForce on a Ball in 3D

Hey guys! I wanted to create a little football game for testing purposes, but i have a problem with the Raycast and the AddForce function. I want to detect where exactly the ball got hit and than add a force from this point to the ball. Like if you click on the top side of the ball it will almost stay grounded and if you hit it on the lower half it will go upwards. The Problem is the Ball is always flying the exact same route, no matter where i click on the ball. I hope someone can help me. Here is my code:

using UnityEngine;
using System.Collections;

public class BallShooter : MonoBehaviour
{
    public Vector3 hitForce;
    private void Start()
    {
       
    }
    void Update()
    {
        if (Input.GetMouseButtonDown(0))
        {
            RaycastHit hit;
            Ray ray = Camera.main.ScreenPointToRay(Input.mousePosition);
            if (Physics.Raycast(ray, out hit))
                if (hit.rigidbody != null)
                    Debug.Log(hit.collider.name);
            hit.rigidbody.AddForceAtPosition(hitForce, hit.point , ForceMode.Impulse);

        }
    }
}

Thank you for helping!

I am not sure of the following, but I guess that because the force is oriented the exact same way, no matter where you click, the Rigidbody flies towards the same direction.

You may need to adjust the force vector according to the normal of the hit surface

public float hitForce;

// ....

hit.rigidbody.AddForceAtPosition(hit.normal * hitForce, hit.point , ForceMode.Impulse);