PYTHON
Efficient Deduplication and Membership Testing with Python Sets
Learn to use Python sets for lightning-fast removal of duplicate elements and quick checking for item existence, crucial for managing unique data in web development.
email_list = [
"[email protected]", "[email protected]", "[email protected]",
"[email protected]", "[email protected]", "[email protected]"
]
blocked_ips = {"192.168.1.1", "10.0.0.5", "172.16.0.10"}
# Deduplicate emails
unique_emails = set(email_list)
print(f"Unique Emails: {unique_emails}")
# Check for membership (O(1) average time complexity)
ip_to_check = "192.168.1.1"
if ip_to_check in blocked_ips:
print(f"{ip_to_check} is blocked.")
else:
print(f"{ip_to_check} is not blocked.")
new_ip = "192.168.1.2"
if new_ip in blocked_ips:
print(f"{new_ip} is blocked.")
else:
print(f"{new_ip} is not blocked.")
How it works: Python `set` objects are unordered collections of unique elements. They are perfect for removing duplicates from a list and perform extremely fast membership testing (checking if an item exists in the set), with an average time complexity of O(1). This makes them ideal for tasks like managing unique user IDs, tags, or blacklists in web applications where efficiency is key.