Workaround for non-equi left join in the hive
Non-equi joins are not supported by Hive: The popular work around is to relocate the join condition to the where clause, which works great when you want an inner join. What about a left join, though?
One of these examples given here is supposed we have an orderLineItem table, and we need to link to a ProductPrice table that includes a productID, price & a date period for which the price applies. We'd want to connect this where ProductID=ProductID and OrderDate are between the start and end dates. I still want to display all orderLineItems if a productID or a suitable date range does not match.
If I implement the normal solution and shift the non-equi filter to the where clause, it becomes an inner join. In the examples above, SQL tinker, and below, I have a product ID that isn't in the lookup.
Given that hive does not accept non-equi-joins, How is a left non-equivalence achieved?
Tables:
CREATE TABLE OrderLineItem( LineItemIDId int IDENTITY(1,1), OrderID int NOT NULL, ProductID int NOT NULL, OrderDate Date ); CREATE TABLE ProductPrice( ProductID int, Cost float, startDate Date, EndDate Date );
Answers
Categories
- All Categories
- 177 LFX Mentorship
- 177 LFX Mentorship: Linux Kernel
- 768 Linux Foundation IT Professional Programs
- 379 Cloud Engineer IT Professional Program
- 175 Advanced Cloud Engineer IT Professional Program
- 75 DevOps IT Professional Program - Discontinued
- 7 DevOps & GitOps IT Professional Program
- 101 Cloud Native Developer IT Professional Program
- 7.6K Training Courses & Learning Paths
- 4 AI & ML Training
- 1 Blockchain & Decentralized Identity Training
- 11 Cloud & Containers Training
- 1 Cybersecurity Training
- 2 DevOps & Site-Reliability Training
- 1 Linux Kernel Development Training
- 1 Networking Training
- 2 Open Source Best Practice Training
- 3 System Administration Training
- 1 System Engineering Training
- 1 Web & Application Development Training
- 796 Hardware
- 202 Drivers
- 68 I/O Devices
- 37 Monitors
- 95 Multimedia
- 173 Networking
- 91 Printers & Scanners
- 91 Storage
- 771 Linux Distributions
- 81 Debian
- 68 Fedora
- 23 Linux Mint
- 13 Mageia
- 24 openSUSE
- 151 Red Hat Enterprise
- 31 Slackware
- 13 SUSE Enterprise
- 356 Ubuntu
- 465 Linux System Administration
- 31 Cloud Computing
- 73 Command Line/Scripting
- Github systems admin projects
- 98 Linux Security
- 78 Network Management
- 101 System Management
- 46 Web Management
- 120 Mobile Computing
- 20 Android
- 85 Development
- 1.2K New to Linux
- 1K Getting Started with Linux
- 395 Off Topic
- 121 Introductions
- 30 Study Material
- 1K Programming and Development
- 310 Kernel Development
- 693 Software Development
- 1K Software
- 400 Applications
- 182 Command Line
- 5 Compiling/Installing
- 69 Games
- 318 Installation
- Archived
- 183 Small Talk
- 2 LFD140 Class Forum
- 1.4K LFS258 Class Forum
Upcoming Training
-
August 20, 2018
Kubernetes Administration (LFS458)
-
August 20, 2018
Linux System Administration (LFS301)
-
August 27, 2018
Open Source Virtualization (LFS462)
-
August 27, 2018
Linux Kernel Debugging and Security (LFD440)
