Note: ip_conntrack interface is getting aged. There is a new set of tools conntrack_tools, http://conntrack-tools.netfilter.org/.
There are a few things we can do to tweak ip_conntrack.
Increase the value of ip_conntrack_max
To find the current setting of ip_conntrack_max:
# cat /proc/sys/net/ipv4/ip_conntrack_max
To temporarily change this value, do
# echo "new_value" > /proc/sys/net/ipv4/ip_conntrack_max
To permanently change this value, do
# sysctl -w net.ipv4.ip_conntrack_max=new_value