Is it possible to override values in values.yaml file when installing a chart?

Yes. You can pass another values file: helm install --values=override-values.yaml [CHART_NAME]

Or directly on the command line: helm install --set some_key=some_value