Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add a second chapter to present Spark DataFrame transformations #5

Merged
merged 29 commits into from
Jun 18, 2023
Merged

Add a second chapter to present Spark DataFrame transformations #5

merged 29 commits into from
Jun 18, 2023

Conversation

pedropark99
Copy link
Owner

This PR brings a new chapter that describes the following transformations:

  • Replacing null values;
  • Removing duplicated values;
  • Merging multiple DataFrames with UNION operations;
  • Merging multiple DataFrames with JOIN operations;
  • Rows to columns with Pivot operations;
  • Collecting and explode operations;

@pedropark99
Add a new chapter for transforming DataFrames
cda4ecb
@pedropark99
Add annotations
5180ed1
@pedropark99
Add new sections for subset of the total DataFrame
1e606c8
@pedropark99
Fix typo
a131ce7
@pedropark99
Add transforming2 file
d8032f9
@pedropark99
Add show action to compare results
7b83159
@pedropark99
Add new topics for chapter 2 and include more content
c62276f
@pedropark99
Add JOIN figures
c062046
@pedropark99
Add two new sections
7d8eecb
@pedropark99
Add more content to JOIN section
b53f6da
@pedropark99
Add JOIN sets image
ed270ff
@pedropark99
Add new set figure
e1f443a
@pedropark99
Add more content to previous sections
a4e4dbf
@pedropark99
Add annotation for cross join
85ef607
@pedropark99
Some small adjustments
aa7fd06
@pedropark99
Add more content for chapter
29a3c83
@pedropark99
Add figure for pivot operations
2f8efed
@pedropark99
Describe the stack() function
3c2508e
@pedropark99
Change function name to lower
9fa5af4
@pedropark99
More content about pivot operations
8e241b8
@pedropark99
Add code example of pivot operation
3e86736
@pedropark99
Rename figure
795a8b3
@pedropark99
Rename sections
a02adb5
@pedropark99
Remove arrays and map section
4111055
@pedropark99
Add new pivot figure
ced420b
@pedropark99
Add more content for explode
a2a1bd8
@pedropark99
Add more content to explain collect functions
d3d78f0
@pedropark99
Recompile entire book
b082216
@pedropark99
Fix typos
86c7395
@pedropark99 pedropark99 merged commit 14f045a into main Jun 18, 2023
@pedropark99 pedropark99 deleted the transf-part-2 branch June 18, 2023 01:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@pedropark99