Larry was a Congressional Liaison.
Larry was usually seen with Ed. They were repeatedly confused for each other by various people, and both appeared to have considerable economic knowledge, often advising the President on economic issues.
In Season 4 Episode 1, Larry quips that he hasn't been married yet. However, it is also mentioned when President Bartlet does his final goodbyes to those in the White House that Larry has a wife and children.