"You may set your mind at rest that these people would never would in 100 years weaken your position with Miss Havisham." Comment

Estella's comment speaks to Pip's unimportance.... it's a warning that he puts too much stock in his position. In other words, people cannot hurt Pip's position with Miss Havisham, because in reality, he doesn't have one.