Place potatoes in a large pan and cover with water. Bring water to a boil and cook for 10 minutes or until tender. Drain and allow to cool. Cut potatoes into bite size chunks.
Mix mayo, vinegar, mustard, salt and pepper in a large mixing bowl. Add celery, onions and potatoes; toss gently. Cut eggs into bite size chunks and stir into potato salad.